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Introduction 



Communication paradoxically belongs to everyone and to no one. 
Because we spend so much time talking and listening, communica- 
tion becomes commonplace. Everyone assumes expertise and confidently 
diagnoses communication problems and prescribes remedies. Unfortu- 
nately, because communication — the process of creating shared meanings 
among individuals who have diverse characteristics and experiences — is 
complex and intricate, these simple prescriptions often fail. Communi- 
cation thus belongs to no one. Teachers and students often talk but do 
not understand each other 

The purpose of this monograph is to improve communication. By 
first acknowledging that we do not comprehend the complexitj' of teach- 
ers* communication, we can begin by trying to develop a conceptual 
understanding of this extremely important interpersonal, dynamic event. 
One way to manage this difficult task is to focus on communication in 
instructional settings. Although instructional communication shares fea- 
tures with communication in other settings such as the home, office, or 
shopping center, its unique characteristics are best captured by looking 
closely at the classroom. We do this by using communication and instruc- 
tional theory to examine assessment strategies that have recently been 
designed. Finally, implications are drawn for the improvement of com- 
munication. 

We focus specifically upon the assessment of communication for four 
primary reasons: 

1. Communication is essential to teaching. 

2. Almost every state now requires formal assessment of teachers 
for initial or for continuing certification, and almost all assess- 
ments claim to evaluate communication abilities. 

3. The term "communication" is used in many ways, and the extent 
to which primary dimensions of communication are incorporated 
into the assessments is not evident. 

4. A description and critique of the ways communication has been 
conceptualized and assessed can inform preservice and inservice 
programs as well as evaluation designs. 

Each of these reasons deserves elaboration. First, the importance of 
communication is generally acknowledged. For example, B. O. Smith 
includes communication as one of the six competencies needed by all 
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teachers in A Design for a School of Pedagogy. Denemark and Nutter 
stated in A Case for Extended Programs of Initial Teacher Preparation^ 
"Communication skills are central to relating not only to students but 
also to professional colleagues, parents, and other community represen- 
tatives ... It requires listening and reading skills as well as speaking and 
writing facility'' (pp. 19-20). Finally, AACTE's Educating a Profession: 
Profile of a Beginning Teacher (February 1983) asserts, *A teacher's ability 
to communicate effectively is essential'^ (p. 5). The emphasis in our anal- 
ysis is upon oral communication (speaking and listening), but similarities 
are often found to other forms of commimicrtvva (partio'ilarly, reading 
and writing). 

The second and third reasons concern iu v . the assessment of teach- 
ers' communications has become so extensive and simultaneously how 
the assessments have emerged with rather diverse ch^iracteristics. Within 
the past decade, more than half the 50 states have implemented assess- 
ments that include some measure of communication ability The meaning 
of "communication," however, differs considerably among the states. At 
one extreme, the process of teaching and the process of communication 
appear almost synonymous. States that have adopted a narrative approach 
to performance assessment (the observer writes an account of what is 
happening in the classroom) accept this global view of communication. 
At the other extreme, observers use an instrument that requires counting 
the frequency of particular communication behaviors such as blatant 
mispronunciations. If judged by one instrument, the teacher might be 
labeled an effective communicator, but the same teacher could be called 
ineffective when the other instrument is used. Plans for improving com- 
munication will obviously differ considerably depending on the concep- 
tion of conmiunication. By describing and critiquing the assessments, 
these conceptions can be identified and improvement strategies can be 
better designed. 

The fourth reason for developing this monograph suggests that cer- 
tain audiences should find the contents useful. The territory overlapped 
by communication and instruction has not been carefully delineated. The 
development of our understanding of teachers* praise illustrates the 
unfolding of complexities within an important concept that is under the 
domains of both instruction and communication. Not long ago, teachers 
were urged to always find the positive in students' ideas and seldom, if 
ever, to be critical (e.g., Diederich, 1963). Through closer study with 
principles from learning theory and communication theory, we now under- 
stand much more about the discriminating use of praise and criticism 
(e.g., Brophy, 1981). This monograph identifies other critical variables that 
merit close scrutiny 

Statewide assessments represent an enormous investment of public 
opinion and professional expertise in the formulation of competency lists, 
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refinement of assessment strategies, and subsequent acUustments made 
after implementation. About 12 states have engaged in this expensive, 
time-consuming ordeal in order to develop consensus upon the ingredi- 
ents of good teaching. By synthesizing their conclusions, significant land- 
marks in the communication/instruction territory are identified for the 
consideration of researchers and teachers. 

Another audience for this monograph should be those involved in 
teacher evaluation. According to Phi Delta Kappa's newsletter (Joekel, 
1986, p. 1), "Competency assessment of teachers or teachers in training 
is occurring in 46 states; only one state has no plans to do so." At least 
10 states are developing or giving serious consideration to adopting per- 
formance assessments. Persons developing these systems can benefit 
from seeing the numerous ways that communication has been included 
in existing assessments. The critiques of these approaches may be even 
more valuable as they elaborate issues that often escape detection. Many 
states delegate the responsibility for teacher evaluation to the local level. 
Persons involved at any level in teacher appraisal or supervision can 
incorporate ideas about teachers' communications from this synthesis 
and criticism of existing assessments. 

As stated earlier, communication appears to be the province of every- 
one. The unstated assumption is that because we spend so much time 
talking and listening we have considerable knowledge, even expertise, in 
communication (Adler, 1983). Why should we devote special inquiry to 
this common activity? While our lay expertise is often adequate for com- 
mon everyday use, more specialized expertise is needed to develop an 
assessment strategy that makes precise distinctions, collectively com- 
poses the essential features of effective communication, and incorporates 
the unique characteristics of the classroom. 

The danger of a casual, unstudied approach to communication can 
be illustrated with a brief historical reference and with a common expe- 
rience in teacher preparation. Communication has often been split into 
matters of style and those of substance, and the lay expert appears to be 
more conscious of style. Plato decried the Sophists who won their lawsuits 
by giving more attention to style than to the discovery of truth (Clarke, 
1953). When preservice teachers are asked to critique a peer's microteach- 
ing, they typically emphasize eye contact and vocalized pauses (e.g., ''ums" 
and "uhs") — matters of style. Less obvious but perhaps more critical 
aspects of communication, such as the quality of the explanation given 
or the precision of feedback, receive little or no attention from the casual 
observer. 

When policymakers or professional educators design and adopt tests 
for teachers that include measures of communication ability, they may 
believe that they have sufficient knowledge of effective speaking and 
listening to judge the quality of the assessment without seeking additional 
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information or expertise. Because communication appears to be the prop- 
erty of each person, it sometimes has been neglected, left unstudied, or 
combined with other instruction features. Therefore, we conclude that 
oral communication deserves separate and specialized study. 

Finally, in reviewing the studies of communication and teacher 
assessment we have been unable to identify any project resembling the 
scope of this monogr^h. No one has systematically described the ways 
that communication has been conceptualized in these assessments. For 
example. Teacher Competence (published in Phi Delta Kappa's Hot Topic 
Series for 1984-85) included about 50 articles. Although communication 
is frequently mentioned, none of the articles focus significantly upon its 
conceptualization or assessment. 

Therefore, this monograph is designed to increase our understanding 
of communication. We do not pretend to be seeking the single best mean- 
ing but do expect that a close inspection of the uses of the term can be 
illuminating. By looking at statewide assessments, we can see more clearly 
how communication has been conceptualized in practice. To establish a 
basis for comparison, we then describe the ways that communication has 
been conceptualized in theory and research related to instmctional com- 
munication. The match and mismatch between practice and theory are 
then appraised from several vantage points. 

The monograph is structured according to the following questions: 

1. What kinds ofnwaning Mve been given to communication Uirough 
the operational definitions fo^md in statewide assessments? 

The first chapter contains a review and analysis of standardized 
measures and performance assessments of teachers' communications. 
Twelve communication categories emerge from an inspection of the per- 
formance assessments. The numerous meanings given to communication 
are further elaborated by an examination of differences within each cat- 
egory Although the categories display considerable variation, the prac- 
tices of assessment generally portray the teacher as speaker, the sender 
of messages, rather than as a participant in a transactional process. 

2. WJiat kinds of meaning have been given to comvmnication in 
the theory and research on communication? 

While the first chapter focuses on practice, chapter 2 shifts to an 
examination of theory and research. Feezel examines the literature on 
instructional communication and develops a model with five critical skill 
areas. He shows how these areas are used for five functions (purposes) 
and in different modes or patterns of communicating. 

3. Wfiat conclusions can be draivn by applying cntical perspectives 
to the ways that teachers' communications have been concep- 
tualized and assessed? 
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The final three chapters discuss limitations in our current measures 
of communication. Brown uses the perspective of the communication 
theorist and linguist to identify important dimensions of communication 
that have received little, if any, attention in the assessments. For example, 
is any attention given to the critical ability of the teacher to engage in 
role taking and then to produce adaptive communication? 

According to their developers, most performance assessments are 
grounded in research on teaching effectiveness. The final two chapters in 
the monograph explore this claim. Book and Duffy find important rela- 
tionships between the assessments and the research but also remind us 
of research limitations related to complexity, context, and curriculum. 
They also identify limitations of that research paradigm and proceed to 
explore implications for communication from an information-processing 
model. Clift also begins with the teaching effectiveness research but helps 
us reconceptualize communication by modifying the metaphor. The shift 
enables us to better recognize both the values and limitations of existing 
conceptualizations. 
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A Review Of 
Communication 
Competencies 
Used In Statewide 
Assessments 



Joseph L. McCaleb 

University of Maryland 



or at least the past decade, many forces have combined to pro- 
duce a demand for testing teachers. These forces include a real 
or perceived decline in student performance, concern for the 
quality of persons entering the teaching profession, and ques- 
tions about the quality of the preparation offered in teacher education 
programs. The demands are evident in recent reform initiatives such as 
the Holmes' Group report (1986) prepared by deans of colleges of edu- 
cation, the Carnegie Commission report (1986) prepared by numerous 
political and educational leaders, and "Time for Results," the National 
Governors' Association report (1986). Each group calls for national stan- 
dards for teachers. 

Statewide assessment of teachers has already been implemented in 
almost every state. These assessments range from standardized testing to 
performance evaluation. The pervasiveness of standardized testing is 
indicated by the widespread adoption of the National Teachers Exami- 
nations (NTE). In 1986, 31 states used some form of these examinations, 
which include tests of basic skills, general knowledge, pedagogical knowl- 
edge, communication skills, and subject area specializations (Educational 
Testing Service [ETS], personal communication, August 7, 1986). Many of 
the remaining 19 states have designed their own examinations. In addition 
to the standardized testing, performance assessments have been imple- 
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mented in 9 states and are currently being considered or developed in 10 
others (Joekel, 1986; Ortman & Tanney, 1986). 

Statewide assessments offer an extremely valuable resource for 
studying the characteristics of teachers' communications. The focus on 
tbo state level is selected not necessarily because the assessments are 
'c9U :r than others but because of the process used to develop and adopt 
the assessments. Typically, adoption involves a lengthy process of public 
hearings and professional scrutiny as the proposed competencies are 
exposed to the diverse constituencies within the state, which include 
rural and urban interests as well as numerous cultural and ethnic per- 
spectives. This scrutiny is then culminated in the crucible of application — 
does the assessment survive the tests of feasibility? What emerges from 
such an ordeaH seldom reflects the initial ideals but embodies the results 
of a democratic process and certainly merits our serious attention. 

Assessments conducted at the state level are also important because 
of their scope. A significant number of teachers and professional educa- 
tors are involved in statewide activities. For these reasons, an examination 
of statewide assessments can reveal much about the nature and practical 
meaning of teachers' communications. 

Inquiring about the extent to which these assessments evaluate teach- 
ers' communications becomes an elusive search. In basic skills testing, 
"communication" typically means reading and writing, sometimes includes 
listening, and almost never has a speaking component. In performai:je 
assessment "communication" typically refers to "correct" language usage, 
pronunciation, and perhaps to certain speech mechanics such as pitch 
and rate. Impoilant communication variables, however, are often dis- 
guised under various competencies with names such as professionalism 
or instruction. The search for the practical meaning of communication is 
further complicated by the various procedures used for data collection 
and interpretation. These complications require a close analysis of specific 
measures in order to uncover the resources offered through statewide 
assessment. This analysis is divided into standardized testing and perfor- 
mance assessment. 



STANDARDIZED TESTING 

Many of the states have adopted basic skills testing, often at the 
point of entry into a teacher preparation program. Typically, the 
basic skills test, such as the Pre-Professional Skills Tests developed by 
the ETS, consists of reading, writing, and mathematics, but omits listening 
and speaking. A m^or exception is the Listening Section of the Test of 
Communication Skills in the NTE's Core Battery As shown in Table 1, 16 
states require the Listening Section. 
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Table 1. Statewide Assessment in Speaking 
and Listening 



Perfonricince Performance Assessment 
State Listening* Speaking** Assessment** Planned*** 

Alabama X 
Arizona X 
Arkansas X 
Colorado X 

Connecticut X 
Florida X 
Georgia X 
Hawaii X 
Indiana X 

Kansas X 
Kentucky X X 

Louisiana X 
Maine X 

Maryland X X 

Mississippi X X 

Missouri X 
Montana X 

Nebraska X 
New Mexico X 
New York X 

N. Carolina X X 

Oklahoma X 

S. Carolina X 

S. Dakota X X 

Tennessee X X 

Texas X 

Virginia X X 

West Virginia X X 

Wisconsin X 



*Information about states using the Listening Section of the NTE Core Battery Exami- 
nation was provided by the Educational Testing Service. 

**Information about states using a test for speaking and performance tests was collected 
through telephone conversations with representatives from the state departments of edu- 
cation and from the NASDTEC manual (Roth & Mastain, 1984). 

***Information about states with plans for performance assessment was provided by Ms. 
Pat Ortman, who conducted a telephone survey of all 50 states (Ortman & Tanney, 1986). 

Statewide standardized testing of speaking occurs in two states. West 
Virginia uses the College Outcome Measure Project of the American 
College Testing Program (COMP/ACT). (Details on this test are given later 
in this section.) Colorado requires prospective teachers to earn a B or 
better in a performance speech course or to make a speech before three 
judges. The five-minute presentation is evaluated on language (e.g., stan- 
dard English usage), delivery, and organization. An increased interest in 
standardized assessment of oral communication is indicated by the ETS*s 
long-range goal of developing a speaking test 
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Because the Listening Section of the NTE's Core Battery is required 
in 16 states, a description of the test is provided. The test consists of 40 
items and requires about 30 minutes to respond to the audiotaped ques- 
tions. Instructions in the practice booklet (ETS, 1984) state: 

The questions are designed to assess your ability to comprehend oral mes- 
sages quickly and accurately, to recall and interpret information, and to 
analyze and evaluate messages. 

More specifically, the listening section measures: 

• basic comprehension of a message, including paraphrasing of a message, 
understanding connotations or words, and summarizing msyor ideas 

• analysis of a message, including identifying assumptions, drawing infer- 
ences, recognizing implications, and identifying a speaker^s tone 

• evaluation of a message, including identifying and evaluating logical struc- 
ture, assessing appropriateness and effectiveness of supporting material, 
and evaluating the effect of a speaker*s tone on an audience 

o feedback-response, including identifying appropriate responses to ques- 
tions or dialogues. 

Our analysis of the test placed 50% of the items in basic comprehen- 
sion, 15% in feedback-response, and the remaining 35% in analysis/evalu- 
ation. Stimulus material ranged from listening to conversations that lasted 
a few seconds to listening to descriptive information that continued as 
long as 75 seconds. The audiotape has about four different voices, includ- 
ing male, female, and a minority dialect. 

The communication assessment portion of COMP/ACT, used by West 
Virginia, is described by Trank and Steele (1983): 

The COMP assessm speaking and writing are defined as the ability to 

communicate about sou ..u institutions, science and technology, and the arts. 
Written and audiotaped stimuli are used as a context for role-playing tasks 
in which participants write letters to friends, legislators and administrators 
or speak to friends, informal and formal meetings. Thus three writing samples 
and three speaking samples are obtained in a variety of realistic contexts. In 
COMP materials, equal emphasis in bo*^h speaking and writing assessment 
is given to rhetorical concerns (discourse or organization), psychological 
concerns (making contact with and attending to the perspective of the 
audience), and practical concerns (such as using vivid language and illustra- 
tions, to dramatize and create an effect). Little emphasis is given to formal 
errors such as mispronounced or misspelled words and pausing or punctua- 
tion, unless they noticeably detract from or obscure the message. These 
criteria are qualitatively scaled, to allow a norm-free judgment of the overall 
effect of a speech or essay (p. 228) 

Several other standardized tests appear to have potential for use in 
screening prospective or begirming teachers according to communication 
ability. McCaleb (1984) reports moderate correlations between two mea- 
sures and the teaching performance of student teachers. The Snyder 
Speech Scale (Snyder, 1981) involves rating a prepared speech on a set 
of weighted criteria derived from pedagogical and communication hter- 
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ature. The Communication Competency Assessment Instrument (Rubin, 
1983) includes a rating on a speech but also has a listening component 
and numerous interview-style questions related to other communication 
competencies such as giving directions and expressing empathy. 

PERFORMANCE ASSESSMENT 

In addition to standardized testing, nine states are estimating the com- 
petence of beginning teachers by observing and evaluating the teachers 
classroom performance. Names of resource persons and documents from 
these states are given at the end of this chapter. Another 10 states are 
developing or exploring this option, which is called performance assess- 
ment. 

Procedures among the nine states for performance assessment are 
quite diverse. This diversity creates special considerations for communi- 
cation. Three variations are especially important. 

1. The definition of variables. Some states write explicit definitions 
for each competency in order to focus upon particular behaviors. For its 
competency on using acceptable oral expression, Georgia gives four spe- 
cific components: enunciation, delivery, usage, and pronunciation. Key 
points for these components are also given to further focus the observer 
on particular aspects of behavior. States that emphasize written definitions 
expect the observers to establish high levels of reliability before they 
observe teachers. 

Other states give the observer more flexibility in defining variables. 
For example, Oklahoma also includes a competency on acceptable 
expression. The only direction given to the observer is a general reference 
to using correct grammar and appropriate vocabulary. In contrast with 
states such as Georgia, the observer has no additional guidance in inter- 
preting **correct" and "appropriate." 

2. The focus of the observer. In many performance assessments, the 
observer is directed to focus upon the teacher's behaviors with deliberate 
exclusion of students and any other persons interacting with the teacher. 
Sometimes the observer is directed to include attention to the learners' 
reactions to specific teacher's behaviors or to the teacher's use of students' 
ideas. The interactive quality seems to vary considerably across instru- 
ments. 

3. The role of the observer. The most restricted role is for the observer 
to tally behaviors. Florida and Virginia have developed variations for this 
role. In Florida, the observer makes a frequency tabulation of precisely 
defined behavioral indicators each time they are demonstrated. For exam- 
ple, the observer makes a tally each time the teacher speaks too softly. 
Kentucky uses Florida's data collection system but adds a professional 
judgment by the observer. 
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Observers in Virginia mark coding sheets at seven-minute intervals 
to make a record of specific teaching behaviors. For example, when the 
teacher is questioning the students, the observer marks appropriate inter- 
sections in a matrix on the optical scan sheet. If the teacher asks a 
convergent question and rejects the students answer, the block would be 
marked where these two categories converge as indicated by the X in the 
diagram below. 

Convergent Divergent Learner*s 
Question Question Question 

1 [ ] 

X] [ ] 

] [ ] 

] [ ] 

] [ ] 



Teacher accepts 
Teacher rejects 
Teacher redirects 
Teacher acknowledges 
Teacher praises 



The observer marks all such intersections that occur in the seven-minute 
period. An intersection would be marked only once during that time period 
even if the combination of behaviors was observed multiple times. 

The m^jor distinction of this role is the attempt to separate obser- 
vation from judgment (Medley, Coker, & Soar, 1984). The observer records 
behaviors without knowing how these behaviors will be combined to 
yield a passing or failing score for the teacher on the competencies. 
Judgments about competencies are made by evaluators who use computer 
analysis of the recorded behaviors. 

A second role has the observer search for a match between a set of 
written descriptions of teaching behaviors and the behaviors that are 
performed by the teacher. South Cat olina has the observer decide whether 
the teacher demonstrates particular behaviors. For exgimpie, does the 
teacher communicate the instructional plan to students? After considering 
several ways that the plan may be communicated, the observer gives the 
teacher credit for demonstrating the competency and cites a specific 
instance or decides the plan was not communicated. 

In using Georgians instrument the observer decides how many behav- 
iors from a set of four are demonstrated. For example, one indicator for 
the competency about communicating with learners is "gives explana- 
tions related to lesson content." The four descriptors are 1) explanations 
of lesson content are clear and easy to follow with appropriate vocabulary 
for learners; 2) communication is precise with few false starts, qualifiers, 
or interrupters; 3) demonstrations and/or examples are used to illustrate 
content; and 4) major points or potential areas of difficulty are emphasized 
using techniques such as repetition or verbal or nonverbal cues. Teachers 
are expected to demonstrate at least three of the four descriptors. Observ- 
ers in North Carolina, Tennessee, and Texas also match behaviors with 
descriptions. 
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The third role for observers involves the preparation of a nayrative. 
Oklahoma has implemented a narrative approach in vy^hich the observers 
take notes related to a general competency such as ^'effectively expresses 
self in written and verbal communication." Later the observers use their 
notes and other information to make a judgment regarding the status of 
the teacher on the competencies. South Dakota and Missouri are also 
moving tovy^ard the use of a narrative approach. (See Evertson & Green, 
1986, for extensive discussion about using <^he narrative approach and for 
comparisons with other coding systems.) 

Each variation among instruments — the focus and role of the observer 
and definition of variables — influences the quality of what is called *'com- 
munication." For example, an exclusive focus upon the teacher imposes 
a linear model with characteristics of a sender of messages. Interactive 
or transactional models of communication (e.g., Trenholm, 1986) require 
the instrument to include all parties involved in the communication pro- 
cess. 

Categories of Communication 

While the states vary along the dimensions just described, they all have a 
list of competencies that can be analyzed for communication categories. 
Two reasons prompt a search for categories: to find which communication 
variables are considered important enough to be included in performance 
assessments, and to describe any differences in how these variables are 
defined. 

Using the general procedures of content analysis (Borg & Gall, 1983; 
Bowers & Courtright, 1984), 12 communication categories were identified 
in competency lists prepared by the states. States that were using or 
considering performance assessments were asked for their competency 
lists and measures. (See the list of Documents and Contacts cn Perfor- 
mance Assessment at the end of this chapter.) These lists were studied 
for explicit uses of the term "communication'* or closely related words 
such as speaking, listening, and feedback. The analysis also attempted to 
identify other variables that relied heavily upon the communication pro- 
cess such as giving directions and questioning. The resulting categories 
were then used to classify the uses of communication within the com- 
petencies and measures. Representatives from states that prepared the 
measures agreed that the classification fairly represented the communi- 
cation variables they considered to be in the competency lists. 

The categories are listed in Table 2. Categories are generally orga- 
nized beginning with the more precise and explicit behaviors and move 
toward those that are more diffused and more imprecisely defined. In 
discussing each category, at least one state practice is cited in detail. 
Significant variations in definition or measurement are also described. 
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Table 2. Communication Categories Dravm from 
Perform/mce Assessments 

Categoiy FL GA KY NC OK SC TN TX VA 

1. Oral language usage 
(Correctness) 

2. Speech mechanics 

3. Fluency 

4. Feedback 
(monitors, praises) 

5. Knowledge of subject 
matter 

6. Explaining 

7. Enthusiasm and 
nonverbal communication 

8. Questioning 

9. Directing 

10. Emphasis 

11. Uses/elicits students' 
ideas 

12. Interaction ' ^ .ts 

*Explicit refere. ogory was found in the state's competency list or measure. In 

sortie cases where lin i .ut gory is unmarked, a state may incorporate the concept within 
another domain. 

**Measurement of this competency is being developed. 

Although the extent to which a category is used across the states is 
indicated, not all states with a competency within the category are dis- 
cussed. 

1, Oral Language Usage (Correctness) 

Educators and others who have participated in developing competency 
lists for teachers often associate communication with correctness of 
language use. Almost all states include a competency with a focus on 
correctness. Interesting variations, however, can be detected in the ways 
states interpret and attempt to measure correctness. 

At one extreme is the holistic, general-impression approach. All of 
Oklahoma's competencies tend to be more general than those of other 
states because its mode of data collection follows an open-ended, narra- 
tive approach. The wording of Oklahoma's competency illustrates the 
holistic method with the general phrase: ''Effectively expresses self in 
written and verbal communication." The observer makes narrative notes 
concerning effective communication without being directed to specific 
behaviors. Oklahoma lists this competency as a ''Professionalism" indi- 
cator. 

Another example of the general-impression approach is found in 
Tennessee. Responsibility for the evaluation of beginning teachers rests 
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with the local level; the state has more direct control over observation 
related to upper levels of the career ladder. Most districts use the state- 
developed observational system with explicit definition of competencies. 
The principal of beginning teachers also makes a holistic judgment about 
whether fijrst-year teachers should be screened out of teaching on the 
basis of professionalism, writing ability, and correctness of oral commu- 
nication. The intent is to retain teachers who provide an appropriate 
language model for students. The principal is urged to base the judgment 
about effective communication on four features: correct grammar usage, 
clear speech, organization of information, and vocabulary use that is 
appropriate to the level of the audience. 

Other states use a more quantitative approach to evaluation and 
define explicitly acceptable grammar, usage, and vocabulary. One of the 
most specific guidelines for evaluating grammar is given by Texas. Located 
in Domain 3, Presentation of Subject Matter, is Criterion 8, Uses acceptable 
• communication skills in presentation. One of the four performance indi- 
cators is "uses correct grammar," and the explanation for this indicator 
states: "Typical errors are 1) use of double negatives, 2) lack of subject- 
verb agreement, 3) incorrect verb tense, and 4) incorrect pronoun refer- 
ence. Two or more errors are cause for denying credit.'' While the teacher 
might lose credit for a particular indicator, in the Texas evaluation system 
(as in other states where the observer "matches" behaviors v^dth descrip- 
tions) the teacher could pass the criterion and, more importantly, pass 
the domain by scoring better on other indicators. Credit for the domain 
is necessary for continued certification; credit for each indicator is not 
essential. 

Policies followed by states such as Georgia fall between the general 
and the specific approaches to correctness. Influenced by recommenda- 
tions fi*om the schools, Georgia increased attention to oral language in its 
1985 revisions. A separate indicator was added for "Uses acceptable oral 
expression." Two of the four indicators concern correctness: one for oral 
language usage, the other for pronunciation. An indicator for written 
language usage precedes the one for oral usage and directs the observer 
to focus upon subject-verb agreement, verb tense, and pronoun reference. 
For oral expression, the key points for pronunciation focus on the pro- 
duction of specific words rather than the overall speech pattern. The 
intention is that the observer judge the students' understanding of the 
teacher's language. Georgia's evaluation system also does not require 
credit on each indicator. At least a minimal level of performance must be 
demonstrated on 75% or more of the indicators. 

Texas elaborates further on the meaning of correct and clear pro- 
nunciation: "The teacher uses correct vowel/consonanVdiphthong sounds 
and emphasizes correct syllables. Speech is fi-ee of slurring or mumbling 
of words." 
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Attempts to evaluate the correctness of language often evoke strong 
objections from advocates of linguistic diversity. Some assessment plans 
have been modified because of objections related to evaluating dialectal 
differences. Florida initially included assessment of correct usage but 
removed the items from its instrument because there was insufficient 
research evidence linking correct usage with effective teaching. An oper- 
ating premise for the Florida Performance Measurement System is that 
only items with research support should be retained. 

As described earlier, Tennessee's local implementation of the state 
guidelines requires the teacher's principal to decide whether the teacher 
should be screened out because of language use. South Carolina also 
makes an explicit reference to dialect in its performance assessment. The 
competency states, "Oral communication by the teacher is free of frequent 
errors in grammar." The explanation for the competency is, "The teacher^s 
language does not contain consistent errors such as subject-verb disagree- 
ments. Spontaneous speech resulting in false starts or elaborate and 
embedded sentences are not considered errors. While accents or dialects 
are not considered here, blatant misprommciations unassociated with 
regional or group convention would deny credit Tlie absence of frequent 
or blatant errors is sufficient evidence for demonstration." 

Despite the problems related to dialect, most educators consider 
correctness of language use to be a critical attribute of effective com- 
munication. When competency lists are developed and submitted to edu- 
cators for validation, the term "communication" seems to be most com- 
monly associated with correct usage. In addition to the states listed above, 
many others (including Alabama, Arkansas, Connecticut, Maryland, and 
New Mexico) have competency lists indicating a relationship between 
effective communication and correct oral language use. 

2, Speech Mechanics 

Instruments used in performance assessment often list speech mechanics 
and correctness items together. Speech mechanics are vocal character- 
istics such as volume, rate, and pitch as well as articulation or enunciation. 
For example, Georgians competency for acceptable oral expression has 
the two descriptors listed above for correctness and two descriptors for 
mechanics: 1) "enunciation makes speech understandable" and 2) "deliv- 
ery (volume, rate of speaking, etc.) is suitable for the situation." Georgia's 
definition of enunciation is given in the key points: "Enunciation is the 
overall pattern of speech, sometimes called diction. Slurring, mumbling 
or other similar behaviors are symptoms of poor enunciation." The other 
descriptor concerns delivery and represents what most states emphasize 
in speech mechanics — ^volume and rate of speech. For example, Tennes- 
see's guideline focuses attention on "speaks clearly at an appropriate pace 
and volume." 
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When observers judge speech mechanics, they usually focus on inad- 
equacies in vocal qualities rather than on positive qualities. Florida is the 
most specific because the observer checks each occurrence of four behav- 
iors: 1) loud, noisy, or grating voice; 2) shrill, piercing, highly pitched voice; 

3) monotone — fails to vaiy tlie intensity, rate, and volume of speech; and 

4) speaks too softly, almost inaudibly 

Rather than focusing on just the teacher, South Carolina instructs the 
observer to base the judgment on the observers perception of the effect 
upon the learner. South Carolina's indicator focuses on potential negative 
effects also: "Speech and voice quality did not interfere with communi- 
cation." Inadequate mechanics are indicated if the learners' concentration 
on the lesson is distracted by any interfering factor in the "volume, tone, 
characteristics, and speech mannerisms." The meaning of "characteris- 
tics" is not explained. 

3. Fluency 

A third category related to the oral language of teachers concerns speech 
fluency. North Carolina uses positive phrasing: "Teacher speaks fluently 
and precisely" Most other states refer to the negative qualities. Florida 
defines control of discourse as connected rather than scrambled and free 
from vagueness words. Examples of vague terms include sometimes, 
maybe, and probably. Georgia considers communication precise when 
there are few false starts, qualifiers, or interrupters. And in Texas, accurate 
language means the teacher does not overuse indefinite or vague terms. 

Tennessee takes a broader perspective on fluency with an emphasis 
on "organized speech." The instructions state: "Mark this category when 
the teacher's spoken presentations demonstrate organization and coher- 
ence. Excessive rambling, jumping back and forth among topics or failure 
to organize points so that they demonstrate a logical flow of information 
will result in no check." Similarly one of South Carolina's 11 criteria for 
acceptable communication is "a logical sequence is followed in the les- 
son." 

4' Feedback (Monitors, Praises) 

Educators seem to value the concept of "feedback" because the term is 
included on most competing lists. As might be expected, however, the use 
of the term varies. In some cases the concern is that the teacher be able 
to gather information (feedback) from the learners about their under- 
standing. This is sometimes referred to as "monitoring." South Carolina 
distinguishes between monitoring and feedback. One of the criteria for 
"fulfilling instructional responsibilities" is to obtain information from 
students to determine the need for clarification, assistance, or ac^ustment. 
"This refers to monitoring during the lesson as opposed to a pretest" In 
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contrast, feedback concerns "the teacher's attempts to inform students 
of tlieir accuracy or progress." 

Monitoring ic further specified in Tennessee's guidelines where the 
teacher "monitors learner understanding and reteaches as necessary." In 
Tennessee's instrument, monitoring includes identifying the learners' 
instructional levels before beginning instruction, pacing activities to 
accommodate learner differences, asking higher-order questions, and 
identifying misconceptions. Effective monitoring results in reteaching the 
material that learners do not understand. 

Georgia also provides an interesting application of monitoring when 
the teacher anticipates misunderstandings. The competency is "Clarifies 
explanations when learners misunderstand lesson content," The four 
indicators are: 1) Areas of misunderstanding or difficulty are identified 
and communications are restated before learners ask questions, 2) Attempts 
are made to eliminate misunderstanding that occurs, 3) Different words 
or examples are used in clarifications, and 4) Clarifications are made for 
individuals or small groups rather than for the entire class or this type of 
clarification is not necessary. 

Feedback is given special attention in North Carolina where: "1) 
Teacher provides feedback on the correctness or incorrectness of in-class 
vi^ork to encourage student growth; 2) Teacher regularly provides prompt 
feedback on assigned out-of-class work; 3) Teacher affirms a correct oral 
response appropriately and moves on; 4) Teacher provides sustaining 
feedback after an incorrect response or no response by probing, repeating 
the question, giving a clue, or allowing more time." 

Georgia also attends to this kind of feedback with an indicator on 
providing information to learners about their progress. The indicator 
includes stating the teacher's expectations about learners' outcomes, 
informing students when their performance is adequate or inadequate, 
and offering suggestions for improving performance. 

Rather than giving a set of features, Texas presents the sequence of 
behaviors for effective feedback on student progress during instruction: 
1) communicates learning expectations; 2) monitors students' perfor- 
mances as they engage in learning activities; 3) solicits responses or 
demonstrations from specific students for assessment purposes; 4) rein- 
forces correct responses; 5) provides corrective feedback, or none needed; 
and 6) reteaches, or none needed. The scoring system, however, does not 
evaluate the total sequence but treats the steps as isolated items. 

In contrast v^th the highly specified components of feedback, some 
instruments do not clarify dimensions but leave interpretation to the 
observer. For example, Oklahoma's competency states that the teacher 
"encourages class participation through interaction with students and 
feedback." Similarly Missouri has the observer judge whether the teacher 
"is inconsistent in giving evaluative feedback" or "gives specific evaluative 
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feedback." Since the instrument is not more explicit about what specific 
behaviors qualify as feedback, the observer has more latitude in inter- 
preting classroom events. 

Virginia indicates that teachers should "conduct recitation, to go over 
material students have studied on their own and make sure they have 
learned it." The observer records behaviors according to the categories 
on the observation form without judging the quality of feedback. The 
judgment about effectiveness of feedback is made through computer 
analysis of combinations of behaviors. The formula for combining behav- 
iors is determined by the state department of education. 

A few instruments isolate a particular type of feedback for special 
analysis. Florida emphasizes specific praise. Teachers should give specific 
academic praise rather than general, nonspecific praise. Teachers also 
should recognize students' responses, amplify, and give corrective feed- 
back. They should not ignore the responses or react with sarcasm, disgust, 
or harshness. 

Texas has similar indicators under the criterion for "Maintains sup- 
portive environment." For the indicator "Avoids sarcasm and negative 
criticism," the observer is advised: "Comments to or about learners which 
personally demean or embarrass them should be avoided. One occurrence 
is sufficient evidence for denying credit." South Carolina has a compe- 
tency on the teacher's positive attitude with the criterion "methods are 
used to positively reinforce students who are engaged in learning." 

5. Knowledge of Subject Matter 

Many states make an explicit link between communication and subject 
matter knowledge. Georgia, South Carolina, and Texas all invoke the loss 
of credit for a competency if one significant error in content is made by 
the teacher. South Carolina's wording illustrates this in two competencies. 
The first states that the teacher's knowledge of subject matter is "com- 
municated with confidence and authority." The other competency con- 
cerns the accuracy of information. One blatant error, noticeable to an out- 
of-field observer and uncorrected by the teacher, denies credit for the 
competency. In Tennessee, the teacher ioses credit for a pattern of errors. 

Elaboration of the relationship between communication and subject 
matter can be seen in Georgia's instrument. The third competency is 
"Demonstrates acceptable written and oral expression and knowledge of 
the subject." One of the four indicators states "demonstrates command 
of the school subject being taught" with these descriptors: 1) demonstra- 
tions and/or information presented to learners are accurate and up-to- 
date, 2) comments and responses to learner questions are accurate, 3) 
content is presented in a logical sequence, and 4) opportunity is provided 
for more than one level of learning. 
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Miiry(aw<^)'j^ V)!an f ;issc\ssing beginning teachers includes a descrip- 
tor under vvu coraniand of subject matter" not found in other com- 
petency sysi e!M..s. The descriptor states: "Communicates information from 
a bias-free multicultural perspective." 

6. Ex])laining 

Explaining is usually identified as an essential competency for teachers, 
tyi)ically under an instructional domain rather than the communication 
domain. The importance of communication to teachers' explanations is 
shown in the narrative approach with the emphasis on clear presentation. 
Oklahoma describes the competency: "makes a clear and adequate expla- 
nation of material presented and procedures followed." Some instruments 
associate explaining with communication factors that have already been 
described. Georgia's four indicators for effective explaining are 1) use of 
emphasis, 2) vocabulary, 3) fluency, and 4) variety of examples. Indicators 
for effective explaining typically refer to the use of examples. 

Several states provide more elaborate definitions of teachers' expla- 
nations. South Carolina calls for several features, including advance orga- 
nizers, logical sequence, use of examples or demonstrations, and para- 
phrasing for clarification if needed. Virginia places explaining in tlie con- 
text of general instruction: "The teacher must be able to see that students 
have the learning experiences planned for them. The teacher must be able 
to: a. present material, to explain, define, demonstrate, etc." Sample behav- 
iors that are combined for this competency include the teacher providing 
an answer to a learner's question, the teacher correcting a learner's error, 
and the teacher reviewing the lesson. 

Tennessee includes providing a clear description of the learning task 
and its content as one indicator among the four for a teaching strategies 
competency. In addition to the components just described, Tennessee's 
instructions tell observers what to do when the teacher uses an indirect 
or discovery method of instruction: evaluate "in terms of the clarity to 
which students are led rather than the clarity of initial student responses." 
The observer is directed to focus on the teacher's behaviors rather than 
the learners'. Another feature is to give the lowest rating if any presen- 
tation of incorrect content or wrong information occurs regardless of the 
presentation's clarity. 

The competency related to explaining behaviors also has been placed 
in special contexts. At least three states (Florida, Kentucky, and North 
Carolina) focus on the explanation of concepts. Florida and Kentucky add 
several items beyond the use of examples: **In presenting concepts the 
teacher is to use definitions, examples, attributes, and non-examples." 
Most states have items related to explaining that focus on giving the 
purpose of the lesson and directing students in their academic work. 




As suggested in the Tennessee example, an interesting trend is to 
consider explanations as a test of the teacher's knowledge of subject 
matter. Texas incorporates **explains content and/or learning tasks clearly" 
within the domain for presentation of subject matter. The link between 
explaining/communicating and knowledge of subject matter is significant 
because one of the few items of near universal agreement about teaching 
is that the teacher should know the subject matter. 

Knowledge of subject matter may be more complex than the repre- 
sentation given by most measures. As articulated in Shulman's (1986) 
recent research program, the ability to instruct a learner presupposes a 
knowledge of content that differs from the way a scholar of the discipline 
understands the content. Thus, scores on a standardized test representing 
the scholar's knowledge may not predict the ability to organize and inter- 
pret the content so that a learner can understand the information. 

This ability to organize and interpret may be referred to as pedagog- 
ical content-knowledge. One test of the pedagogical content-knowledge 
appears to be the teacher's ability to communicate the content to a par- 
ticular set of learners. Florida is attempting to develop instruments that ; 
measure pedagogical content-knowledge. These instruments Avpiild sup- 
plement the standardized, multiple-choice testing for knowledge of sub: 
ject matter now used by most states. 

7. Enthiisiasm and N(mverbcd Communication 

More than half the states conducting performance assessments consider : 
the communication of enthusiasm to be an essential teacher competency- 
Oklahoma simply asserts that teachers should exhibit enthusiasm for the i 
subject matter without indicating how this might be done. Other states '■ . 
are more explicit with most citing nonverbal expressions as ways to 
demonstrate enthusiasm. 

South Carolina elaborates that enthusiasm for learning ari teaching 
is communicated when the teacher "demonstrates excitement, vx\jpymeut, 
or animated involvement in learning through intense or dramatic eocpres- 
sion in gestures, movements, vocal inflections, or facial changes^'- l%f 
directions to the observer continue: "It is not necessaiy to dernbnstrate 
enthusiasm throughout the perior^ but one example of more tlmn^icL 
momentary compression must be cited for evidence. If demonstrated— . 
Give a specific example of enthusiasm. If not demonstrated — State: *No 
enthusiasm was demonstrated.' " South Carolina's experience in training 
observers shows that they n- it often award credit for vocal expressive- . ; 
ness. 

Georgia's specification of "communicates personal enthusiasm" is .. . 
similar as it includes facial expression, eye contact, voice inflection, ener- 
getic posture, and gestures. Georgia's key point to the observer goes 



further and states that these nonverbal behaviors may be insufficient. The 
observer should monitor the learners to see if the teacher tends to inspire 
their attention and involvement. Florida contrasts the positive nonverbal 
behaviors with negative ones. The teacher should use body language that 
shows interest (smiling, gesturing, and steady eye contact) rather than 
lethargy (deadpan expressions and frowns). 

Florida also looks for explicit verbal statements concerning enthu- 
siasm. In a section labeled "task attraction and challenge," the observer 
notes teacher's behaviors that show "genuine zest for a task " The teacher 
also gets credit in this section for challenging the learners. For example, 
the teacher might make a zealous statement such as, "This next exercise 
is going to be fun; I know you will er\joy it." 

& Questioning 

Performance assessments have not provided as much emphasis on teach- 
ers' questioning skills as might be expectei from the attention in peda- 
gogical literature. Perhaps the most extensive treatment is in Virginia, 
where the observer marks a nuntber of questioning patterns such as 
teacher asks a convergent question, student makes a response, and teacher 
rejects the student's response. (This was illustrated earlier in the section 
on the roles of the observer.) 

Sometimes questioning is included within a criterion that states the 
teacher should demonstate a diversity of instructional methods. Georgia 
demonstrates this general concern for questioning with an evaluation of 
the teacher's assessment of learner progress during the lesson, 

Florida and North Carolina isolate two features of questioning. Con- 
sistent with the training provided most preservice teachers, one feature 
is the use of several types of questions. Florida's observers record the 
frequency of questions. They also separate academic questions (including 
higher-order questions) f ;m the nonacademic, procedural questions. North 
Carolina's competency focuses on appropriate levels of questions with a 
high rate of success. Both states also expect teachers to ask "single 
questions" so that the learner will not be confused, Florida states "Teacher 
asks direct questions one at a time without rephrasing or giving additional 
information." 

South Carolina approaches competency with questioning in a more 
general way, from the leamerls perspective. The competency states that 
questions meet the students' level of understanding. 

9. Directing 

Another competency that receives less attention in performance assess- 
ments than in literature on classroom management is giving directions. 
Sometimes directing is contained within a more general competency 
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about effective classroom management. Observers in Oklahoma note in 
their narratives how well the teacher "gives clear, explicit directions to 
students." 

Virginians competency provides more explicit attention to giving clear 
directions: "Students understand what is expected of them. The teacher 
who knows this moves about during independent study and asks students 
if they need help." An example of a behavior related to this competency 
is when the observer records the teachers making an oral assignment 
and giving step-by-step instructions. 

One of Texas' five indicators for organizing materials and students is 
"gives clear administrative directions for classroom procedures or rou- 
tines." The explanation for this indicator states: "The teacher communi- 
cates to the students what activities and/or tasks are to be done; when, 
where, and how the activif*ro>. and/or tasks are to be done; and who will 
be involved in the activities .t^kh or tasks." Texas as well as South Carolina 
and Georgia have a related competency for communicating expectations 
(rules) for student behavior. 

10. Emphasis 

As a subset of presenting information, several states recognize the impor- 
tance of emphasizing particular points within the information. One of 
Georgia's indicators for effective explanations is that "msyor points or 
potential areas of difficulty are emphasized using techniques such as 
repetition or verbal or nonverbal cues." Texas elaborates: "The teacher 
uses strategies to emphasize to the students the structure of the content. 
For example, the teacher uses voice inflection, underlines important points, 
repeats points for emphasis, explains relationships. If instruction pro- 
ceeds without some points standing out, important dimensions have not 
been adequately specified." In Florida, observers note the frequency of 
"marker expressions, marker techniques, and repetition.'' To receive credit 
for this competency, the teacher tells students explicitly that specific 
information is important and repeats or restates the important points. 

11, Uses/Elicits Students' Ideas 

Another skill receiving attention in a few states concerns the teacher's 
ability to encourage students to communicate their ideas. Georgia focuses 
upon this dimension more than others through the competency "uses 
learner responses or questions regarding lesson content." The descriptors 
are: 1) Comments, questions, examples, demonstrations or other contri- 
butions are sought from learners througliout the lesson; 2) Learners who 
wish to comment or to seek assistance are recognized or no learners seek 
recognition; 3) Learner responses, ideas, questions, or other contributions 
are acknowledged; and 4) Learners' ideas are elaborated in the lesson 
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through teacher comments, questions and/or extended wait time. Other 
states, including Oklahoma and South Carolina, also affirm the importance 
of teachers encouraging students to express their ideas. 

A related competency concerns the teacher's ability to engage the 
students in discussion. Two of Missouri's 19 competencies focus on com- 
munication. One, already mentioned, concerns feedback; the other is 
difficult to classify because of its generality: ^^demonstrates ability to 
communicate effectively with students." The guideline for a satisfactory 
rating seems to place it within this category as the teacher is expected to 
**encourage relevant dialogue" with students. 

An interesting variation on the teacher's ability to promote the com- 
munications of learners is Connecticut's concern for fostering the inde- 
pendence of the student as a learner. Teachers can facilitate independence 
by probing with questions that stimulate students to recall, analyze, syn- 
thesize, and evaluate. Connecticut's document also asserts that teachers 
can express an expectation for independent learning. 



12. Interacting With Parents 

In addition to communicating effectively with learners, teachers are often 
expected to interact positively with parents. This competency is often 
stated in initial plans for competency assessment, but it is sometimes 
minimized as the emphasis focuses upon classroom observation. For 
example, Georgia includes communicating with parents in an optional 
instrument on professional standards. 

Oklahoma has retained this competency, perhaps because its narra- 
tive approach allows data collection outside the classroom. The compe- 
tency states that the teacher interacts and communicates effectively with 
parents and staff. Similarly, Tennessee's descriptive approach to gathering 
data about beginning teachers includes an item related to communication 
with parents. The competency, "reports learner status and progress to 
learners and their parents," has these descriptors: "explains grading stan- 
dards to students and parents; keeps accurate records of student progress; 
submits report cards on required timelines; holds conferences with par- 
ents." 

Texas is in the process of implementing a performance assessment 
that includes a criterion "interacts and communicates effectively with 
parents." Indicators of this criterion document certain behaviors: 1) ini- 
tiates communications with parents about student performance and/or 
behavior when appropriate, 2) conducts parent-teacher conferences in 
accordance with local district policy, 3) reports student progress to par- 
ents in accordance with local district policy, and 4) maintains confiden- 
tiality unless disclosure is required by law. 
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Plans for performance assessment often begin w'th more extensive 
attention to teacher-parent communications. For ei.a; Tuple, Connecticut's 
list of competencies includes '^Encourages and muhitains the cooperative 
involvement and support of parents and the vjitimunity." Indicators for 
this competency include: 1) establishes on<>c ring two-way communication 
with parents based on mutual respect, 2) obtains and uses information 
about students from parents, 3) communicates goals and objectives for 
both urogram and student to f)arents, and 4) conducts effective parent^ 
teacher conferences. Although procedures for assessing other competen- 
cies have been developed, Connecticut has not yet implemented this 
competency. 

Summary 

All the states reviewed in this chapter have asserted the importance of 
teacher communications in their competency lists and performance mea- 
sures. Twelve categories have emerged. The categories represent the 
prevailing perceptions of those communication dimensions that are 
important and/or measurable. They also sketch the parameters of under- 
standing. For example, speech mechanics can be precisely defined but 
are not uniformly considered essenti£il. The concept of feedback is valued 
by all, and rather precise components of monitoring are specified. Com- 
munication as an index to the teacher's knowledge of content is an exciting 
frontier. 

Overall, the emphasis has been upon characteristics of the teacher 
as a speaker. Nine of the dimensions (correctness, mechanics, fluency, 
knowledge of subject matter, explaining, enthusiasm, questioning, direct- 
ing, and emphasis) focus on the teacher with limited or no attention to 
any other party in the communication. 

Much less attention has been given to communication as a dynamic, 
interactive process than to the linear, one-way flow of information. A 
problem may be exhibited in the tension betv/een a dynamic concept and 
the restrictions imposed by particular systems of measurement. The 
dimensions of feedback, use of student ideas, and communicating with 
parents generally reflect the process approach to communication. In some 
instruments other dimensions also look beyond isolated teacher behav- 
iors. For example, questioning sometimes includes attention to rate of 
success or adjustment to the level of the learner, and teachers* enthusiasm 
can be related to pupils' interest. The more recent attempts to focus on 
the communication of the teacher's understanding of subject matter begin 
to look at an exchange of meaning rather than the sending of messages. 

This analysis of how states are assessing teachers' communications 
provides a useful map of our practical understanding of instructional 
communication. In order to advance this understanding, theoretical mod- 
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els of communication need to be considered. Consulting research on 
teaching and communication also can promote our understanding of 
teachers' communications. Building a better understanding of communi- 
cation promotes the advancement of assessment and development of 
effective teaching. 
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"ears ago when I was a novice high school teacher I remember 
being asked by a seasoned veteran, "Do you teach kids or do 
you teach speech?" Actually he was only half-seriously testmg 
— - me with that question, which even then I realized as an unfair 
dUemma. It is encouraging to note from chapter 1 that there are attempts 
at testing teachers more fairly with the recognition that teaching mvolves 
both aspects of the question— that is, communicating subject knowledge 

to "kids." ^. „ . „ ^ 

Skill in communication is central to effective teachmg. Hurt, Scott, 
and McCroskey (1978) once suggested that communication was the dif- 
ference between knowing and teaching. Knowing your subject field plus 
principles and strategies of teaching is only part of the task; bemg able 
to teach what you know requires the application of communication skiUs. 
Many studies have demonstrated the relationship between a teachers 
communication and successful classroom instruction (Daly & Kormek, 
1980; Feezel & Rubin, 1983; Rubin & Feezel, 1986). Therefore, the assess- 
ment of how well teachers communicate may be central to the improve- 
ment of their teaching effectiveness. Those assessments must be designed 
and implemented, however, according to a valid and coherent conception 
of the complex process of communication in instruction. Otherwise, the 
jud<*ments of a teacher's communication may be based on ill-conceived, 
inaccurate understandings of process; isolated discrete factors that may 
be insignificant; or piecemeal measurements without a unifying prmciple_ 
The purpose of this chapter is to review conceptions of the field of 
communication generally, with particular application to the speech com- 
munication of teachers. Because many states are involved in the national 
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frend toward teacher testing, as McCaleb noted in chapter 1, there is the 
danger that these efforts wiU not always follow conceptions that fit the 
realities of teaching. The varied and sometimes superficial approaches to 
communication assessment across the states raise the dangerous possi- 
bility of judgments based upon an incomplete or fragmented picture of a 
teachers comniunication skiUs. For example, McCaleb noted in chapter 
1 that 9 of the 12 communication dimensions assessed by states focus on 
specific factors of the teacher without considering the dynamics of the 
teacher interacting with others. Throughout the chapter we see that cer- 
tain state assessment practices may focus on discrete, isolated mechanics 
of communication rather than a carefully integrated holistic assessment 
based upon a soundly conceived view of communication instruction 
Iherefore, this chapter draws from current concepts in the field and 
previous research findings to synthesize a holistic conception of the 
teacher communication process. 

The field of communication has been in existence since the time of 
Isocrates^ one of the first teachers of speech in Athens during the fifth 
century B.C. The primaiy role of Isocrates and other teachers after him 
was to develop skilled speakers to participate in the democratic gover- 
nance of the city states. His students were taught to prepare, memorize, 
and declaim somewhat formal speeches in the assemblies and courts The 
Greek society was centered in oral discouree, with aU citizens expected 
to actively participate by arguing their views on issues. Thus rhetoric, as 
the focal point, of aU education, was the art of persuasive discourse- 
especially through logic or argument Just as education today has expanded 
considerably, so too, has speech education and the role of communication 
m instruction Although a focus on persuasion and argument remains, 
much of teacher communication involves other roles and functions such 
as explaming information or oraUy interpreting an author's words 

The breadth and variety of communicative functions were reviewed 
by the Speech Communication Association (SCA) National Project on 
bpeech Communication Competencies (AUen&Brown, 1976).Three vears 
of research and development led to several conclusions, including a def- 
inition of communication competence and a functional approach Com- 
petence mvolves arepertoire of experiences or strategies from which one 
!i H evaluates the communicative performance. 

Although these dimensions of competence were developed as applicable 
to aU communication, they seem especiaUy fiti:ing to teacher communi- 
cation. The repertoire involves what is known of subject and pedagogy 
but teachmg constitutes selecting, implementing, and evaluating whatTs 

.V. . -^^ P'""-'^*'^ developed a functional approach to competence 

that IS broader than the persuasive focus of ancient times. In addition to 
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communication that functions to control or influence others, we may use 
communication to inform, express feelings, imagine, or perform social 
rituals (Allen & Brown, 1976). 

1. Ritualizing. These are the everyday social graces of greetings, 
tumtaking, raising hands, and other such means of regulating the 
formalities required by the situation. 

2. Informing. The purpose is primarily to give or seek information, 
data, ideas, or knowledge. This function probably occupies most 
of tlie time-on-task in teaching. 

3. Controlling. The intent is persuading or attempts to influence the 
ideas, behavior, or feelings of others. 

4. Expressing Feelings. Although feelings may be involved in the 
other functions, the primary purpose here is expressing attitudes 
or emotions without trying to influence; the focus is self-expres- 
sion or disclosure of affective states, 

5. Imagining. This usually involves aesthetic activities for creativity, 
roleplaying, exploring hypothetical instances, or fantasizing. The 
purpose may be to entertain or to envision or predict the future. 

These five functions recognize more fully the numerous purposes 
served by communication. Much of the classroom role of teaching involves 
the informing process, whether explaining through lectures or seeking 
information through questions and discussions. Other aspects of teacher 
communication employ professional and social rituals, using or encour- 
aging imagination, relating to feelings, and conununicating to control a 
situation. Any assessments of communication in instruction must recog- 
nize the breadth of functions served and integrate them into a view of the 
total process. The prominence of these five functions articulated by the 
national project is evident from their use in nearly 30 publications on 
instructional communication, including articles, books, curriculum guides, 
and assessment standards. 

We can see that the study of oral communication has undergone 
considerable development from its roots in ancient rhetoric to the tax- 
onomy of speech communication developed by another SCA national 
committee (McBath & Jeffrey, 1978), Its description of the contemporary 
field begins with a definition of speech communication as a study of "the 
nature, processes, and effects of human symbolic interaction" (p, 187). 
Any situation or context where humans are using language along with 
nonverbal codes (e.g., body movements, facial expressions, distances, 
etc.) to send and receive messages may be examined by communication 
assessments. Just as our world is more complex today than in ancient 
Greece, so too is speech communication a much broader and more com- 
plex endeavor than simply speechmaking. Such breadth is evident in the 
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following m^or categories of the McBath and Jeffrey taxonomy (1978, 
pp. 187-188). 

Code Systems: verbal and nonverbal 
Interciiltural Communication, across ethnic backgrounds 
Interpersonal Communication: person-to-person and groups 
Organizational Communication within formal systems 
Oral Interpretation of literature through performance 
Pragmatic Communication to influence or aid decisions 
Public Address: speakers, campaigns, and movements 
Rhetorical and Communication Theory to explain behaviors 
Speech and Hearing Science: physiological and acoustical 

These categories of research and development in speech communication 
show the complexity of the total process that must be considered in any 
coherent conception of teacher communication assessment. They also 
constitute subdivisions of the field wherein considerable research and 
expertise exist. (Further information about the taxonomy is available 
from the SCA, 5105 Backlick Road, Annandale, VA 22003.) 

Speech Communication Education, another category of the McBath 
and Jeffrey (1978) taxonomy, is the focal area for this monograph and the 
conception of teacher communication skills in the remainder of this 
chapter. Subdivisions within the category are (1) Communication Devel- 
opment, acquisition and use of skills by normal children; (2) Oral Com- 
munication Skills, improving individual competencies in speaking and 
listening; and (3) Instructional Communication, communicative factors 
involved in the teaching-learning process. 

The third subdivision, instniction£d communication, has been the 
subject of much contemporary research on the oral communication com- 
petencies that all teachers must attain. An overview of some msgor areas 
of that research will show the skills that must be encompassed by a 
complete conception of teacher speech communication. The intent here 
is not to provide a complete review of research findings but rather to 
identify the types and functions of teacher communication to be included 
in a holistic assessment. 



he SCA and the American Theatre Association (ATA) prepared a set 



JL of competency models for elementary and secondary teachers (SCA/ 
ATA Joint Task Force on Teacher Preparation, 1978). The skills identified 
for teachers in all content areas were grouped into six main competency 
areas: (1) preparation of messages appropriate to various audiences and 
purposes; (2) delivering messages appropriate to various contexts; (3) 
analyzing and managing factors in communication processes; (4) dem- 
onstrating effective listening skills in a variety of contexts; (5) demon- 
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strating values that promote communication proccsse'i :\ ' ^ 
riences appropriate to a multicultural, democratic society , auu {{)) » ccog- 
nizing the role of mass communication in American society. I'hese were 
further reduced to specific skills and behaviors. For example, under Hoi"^- 
ering messages appropriate to various contexts, one skill area \m • " 
onstrating the appropriate use of verbal and non-verbal language by": 

1. delivering messages for a variety of communication purposes and 
audiences, 

2. demonstrating a sense of drama in storytelling or reading aloud, 

3. enhancing listener comprehension and interest through facial and 
bodily expressions that are congruent with meanings, 

4. demonstrating enthusiasm in relating with others. 

These are simply examples of the specific kinds of statements that may 
make appropriate standards for assessment. It appears from chapter 1 
that not all state assessment procedures have reached this level of spec- 
ificity in criteria, nor have they all attended to the complete sets of 
standards contained in the SCA/ATA document. Yet all six competency 
areas seem important to an assessment of the total competence of an 
instructor and should be included in a complete conception of instruc- 
tional communication. 

Another paradigm (Lynn, 1976) concisely grouped communication 
skills into two categories, message-sending and message-receiving. The 
message-sending skills included: 

1. analyzing students to determine initial guidelines for message 
construction — most suitable presentation channels, most engag- 
ing delivery techniques, etc.; 

2. selecting, organizing, supporting, and clearly expressing ideas in 
a verbal and nonverbal manner appropriate to the students, e.g, 
giving directions, lecturing, explaining, questioning, stimulating 
discussion; and 

3. using numerous ways to solicit feedback, express approval or 
disapproval, and criticize or evaluate student communication. 

The basic message-receiving skills for teachers were: 

1. identifying central ideas and supporting arguments; 

2. weighing evidence and reasoning; 

3. listening for different levels of meaning in messages; 

4. listening and responding with empathic sensitivity; and 

5. interpreting nonverbal messages. 

Together, Lynn*s (1976) categories reflect an important balance in 
attention to the two-way process of communication that must be recog- 
nized in a coherent conception of instructional communication. In addi- 
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tion, the skills listed above identify many specific areas of research con- 
ducted after she categorized competencies. 

Communication and education research during the past 10 years has 
identified trends in communication variables thought to be important in 
teacher assessment (Feezel & Rubin, 1983; Rubin & Feezel, 1985; Staton- 
Spicer & Wulff, 1984). There are five focus areas in recent teacher com- 
munication research— lectures, verbal communication, questioning skills, 
nonverbal communication, and interpersonal relations — that indicate how 
assessment might be conceptually grounded. These research clusters may 
also be compared with the 12 state assessment dimensions identified in 
chapter 1. 

Lectures. Weaver and Michel (1983) list many studies that include such 
variables as mediated lectures (e.g., videotape or film), mass lectures, 
organization, nonverbal code use, and training teaching assistants. This 
topic area, which is like formal public speaking with its traditional treat- 
ment of informing and persuading, is central to instructional communi- 
cation. In terms of the assessment trends noted by McCaleb in chapter 1, 
at least 6 of the 12 dimensions used seem to pertain directly to lecturing 
(correctness, mechanics, fluency knowledge of subject, explaining, and 
emphasis). 

Factors such as limited attention spans of learners, demands for 
variety and excitement (to compete with television's pace or visual appeal), 
and bad lecturing practices, however, have led to the need for using 
alternatives to lectures. Innovative s^proaches include discussions, games, 
simulations, small groups, independent study and field projects. This trend 
shifted classroom communication research emphasis to a broader exam- 
ination of teachers' verbal and nonverbal skills. 

Verbal communication. A second rather general and eclectic research 
cluster is frequently indexed as **teacher verbal behavior'' in the Educa- 
tion Index. This label encompasses much research on several variables 
of teachers' verbal communication, not simply lecturing. Variables exam- 
ined include praise, attention, approval, and feedback. Some of these 
topics have been given considerable attention (Brophy 1981). In contrast, 
a teacher's use of humor is .another interesting research line that has 
received only slight attention. Bryant (1979) identified patterns of humor 
in college teachers that may have influence on learning. Both research 
areas have stressed a functional approach like Allen & Brown (1976). It 
appears that humor and praise can be integrated with several of the five 
functions, depending upon context, showing the importance of a holistic 
integration of communication factors in teaching assessment. 

Teacher clarity has been another major, promising line of research 
focus during the past few years (e.g.. Land, 1981; McCaleb, 1984). McCaleb 
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and Rosenthal (1984) noted that patterns of expl^mations, vagueness 
terms, vocal hesitations, and checking for understanding have potentid 
for positive influence on both student achievement and perceptions. This 
is an ongoing research topic that is central to much of teaching and relates 
most closely to the informing function. Language variables in teacher 
verbalization have received attention in the areas of ethnicity and sexism, 
but other factors such as language intensity or probability words have 
been largely neglected. 

Extensive research has been done in sociolinguistics, or language 
and social class, and in the general area of classroom interaction. Findings 
have not been included here because of the monograph's focus on assess- 
ing teachers' communication rather than the learners'. 

Attention given to language and verbalization in research is mixed, 
with some topics, such as clarity and praise, examined more than otheris: 
Explaining was one of the 12 focal dimensions deemed central to teaching 
in the state assessments. Yet the place of language in verbal assessmeiit 
seems to be largely that of correctness and fluency with scant attention 
given to more interactive process factors such as humor and language 
interpretations by learners. Generally, both the research and assessment 
practices have concentrated on the teacher's precision with little attention 
to the dynamics of interaction with students in the instructional uses of 
language. But the findings of many studies on humor, clarity, prmse^ feed- , 
back, and ethnicity often have implied that the assessment of a teacher's 
use of language must rely on individu£d learner factors. This suggests that 
analysis of learning contexts and the dynamics of shared meanings must 
be central to a conception of communication in instruction. 

Questioning skills. Questioning overlaps the verbal cluster, but is treated 
separately because research focused on this area has been conducted and 
indexed independently from the above categories. Much research has 
focused on the questions teachers use. One review of published "teacher 
talk" research in the last five years revealed more than 25 studies with 
variables such as types and levels of questions, phrasing, probes, response 
duration, wait time, and leading discussions (Feezel & Faix, 1983). Still, 
much remains to be learned about questioning behavior. For example, a 
major researcher in this area found only half the responses of high school 
students were on the same cognitive level as the teacher's question (Dillon, 
1982). This finding and the conflicting findings of several studies on the 
efficacy of higher order questions represent at least two points for further 
research. 

Nonverbal communication. Smith (1979) presents an extensive and 
detailed review of almost 250 articles and books about environment, 




space, body movement, facial expresrion, eye use, physical appearances, 
objects/apparel, ?v. ' vocal cues. From this, Smith concludes that vocal 
cues and silen/r-' / ^>r . . leglected variables in research on teaching. Although 
Stem (1980) abii i.' -^d the teacher's voice in relation to acting ai'\d Ander- 
son and Withrow ;^^981) studied the effect of nonverbal expressiveness, 
little research on vocal cues has beerti done since 1979. 

Nonverbal communication is especially important because of its rela- 
tionship to expressing feelings. Many st? assessment procedures empha- 
size the expression of enthusiasm nonverbally. The neglect of research 
into vocal cues in teaching contrasts with the stress on voice mechanics 
in many state systems. Perhaps research on voice in teaching would reveal 
whether such irnportance is warranted. Few workable systems for ana- 
lyz'ihg nonverbal codes in teaching have been developed and widely used. 
Only two systems integrate the nonverbal with verbal categories for a 
n. "^e complete communication analysis (see Galloway in Simon & Boyer, 
1967, and Cambra's VAN system in Feezel, 1983). Further research could 
test these systems and work toward a theoretical synthesis of verbal and 
nonverbal skiUs in teaching. 

Interpersonal Relations. This cluster of variables includes several stud- 
ies that focus on interpersonal skills and relationships. Factors such as 
teacher warmth, openness, self-disclosure, supportive/defensive climate, 
listening witli empathy, and interpersonal solidarity have been examined 
in research efforts (e.g., Boser & Poppen, 1978; Rosenfeld, 1983; Wasser- 
man, 1982). Interpersonal relationship factors may be associated more 
with learner attitudes and motivation or affective learning than with the 
learning of objective content. This suggests an association with the func- 
tions of feelings ntualizing, and controlling more than informing. 

State assessments reviewed in chapter 1 also touch upon this cate- 
gory only occasionally in relation to the interactive dimensions of feed- 
back, use of student ideas, and interactions with parents. Nevertheless, 
the importance of this cluster frequently is stressed in student perceptions 
and underlined by expert opinions. Interpersonal research has been con- 
ducted in many disciplines, but it represents a msy or area of contemporary 
study in speech communication with numerous scholarly contributions, 
including direct applications to instructional communication (Feezel, 1983). 

From this revie'^v of the research arras in instructional communica- 
tion, it seems that Allen and Brown*s (1976) five functions have been 
differentially treated. Variables relative to informing, controlling, and 
expressing feelings have been researched more than the others. The 
ritualizing lunction may have been examined slightly in indirect ways but 
not as a focal point. Similarly, the teacher's use of imagining for creative 
or predictive activities has been the least researched topic area in speech 
communication. Yet all five functions are viable and relevant to commu- 
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nication in the instruction of any subject, though the prevalence of some 
may vary with the subject matter. An implication of this review, then, is 
the need for further research pertaining to ritualizing and imagining func- 
tions. 

The five clusters of instructional communication research reviewed 
above indicate the factors that have been identified as significant to 
effective teaching. The results and conclusions of the research may be 
consulted for detailed guidelines, but this overview suggests the elements 
that must be considered for a complete, coherent process approach to 
communication skill assessment of teachers. 

One issue raised by the studies and theoretical perspectives in 
instructional communication is how to organize our knowledge of teacher 
communication skills into a coherent conception. Communication theo- 
rists have often attempted to forge comprehensive models of this complex 
process, but no single conception has been definitive. Some contemporary 
theorists have indicated, however, that any model of human communi- 
cation must recognize the complex, ongoing, and simultaneous nature of 
the cue-exchanging process involving two or more individuals. Although 
earlier communication models have viewed the process as an interaction 
with messages being sent back and forth between two people much like 
a tennis match, the concept of a transaction seems more accurate. As 
McCaleb noted at the end of chapter 1, we should view teacher commu- 
nication as an "exchange of meaning rather than just the sending of 
messages" (p. 25). The concept recognizes that when two or more people 
are face-to-face, perception and reaction to cues are constant and 
simultaneous. 

It is more accurate to say that we adjust and change our messages 
midstream based on the totality of reactions we observe or hear from our 
listeners. Even in the tennis analogy, good players do not simply wait idly 
for the ball to be in their court. They constantly adapt to the strategies 
and moves of the opponent. The communication process is not one of *'I 
speak-now you speak-then I speak-then you . , but is a mutual and 
continuous exchanging of verbally and nonverbally coded ideas, feelings, 
etc. 

This transactional perspective has been attempted in several contem- 
porary models (e.g., Barnlund, 1970; Bols 1978; Feezel, 1983; Harris, 1967). 
All are generalized models of communication, though, and not applied to 
the nature of educational communication situations. The classroom is a 
similarly complex transactive process of communication. Therefore, the 
instructional communication conception that follows is an attempt to 
synthesize the numerous factors studied in research into a transactional 
model of teacher communication. This conception may then be used to 
guide assessment efforts to help assure that valid, holistic judgments are 
made about teacher communication skills. 
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A COHERENT CONCEPTION OF TEACHER 
COMMUNICATION 

The process of speaking and listening within the role of *'teacher" is 
best conceptualized in terms of an ordered set of five skill areas that 
constitute the ABCDEs of instructional communication. Each compe- 
tency or skill identified in the previous research overview can be located 
within one or more of the five phases. These are sequential steps only in 
the sense of beginning with A and progressing to D or E for an initial 
situation or episode. Otherwise these are not linear steps but a constantly 
iterative process of interwoven factors or phases. Throughout a situation 
or communicative interchange the participants would be constantly cycling 
through the five skill areas. 

A. Analyzing the situation. The teacher needs to be skilled in noticing, 
identifying, and interpreting the varieties of situational codes and cues. 
For example, Lynn's (1976) initial message-sending category of "analyzing 
students to determine initial guidelines for message construction" is incor- 
porated here. This phase is important for the initial "understanding" of 
the people and the setting, but continues throughout the occasion as 
teachers constantly note and adjust to their perceptions of cues. The 
interpretation of both verbal and nonverbal cues would be important 
skills here, and the application of rhetorical and communication theory 
from the McBath and Jeffrey (1978) taxonomy would be central to this 
phase. 

B. Being willing to conununicate. The teacher must have the internal 
strength and motivation to communicate as required by analysis of the 
situation. This could involve such factors as self-confidence, low appre- 
hension or reticence, willingness to get involved with others, and asser- 
tiveness to exert rights to influence or control students. The relevance 
and assessment of such factors are noted in Rubin and Feezel (1986). A 
willingness to appropriately self-disclose could also be a factor in this 
general area Thus some of the research into interpersonal relations reviewed 
earlier could pertain to this phase as well as Phase C below. All these 
factors have been regarded as skills amenable to assessment and devel- 
opment. 

C. Creating a climate for persons. Teachers must build interpersonal 
relationships with students, staff, parents, etc., because such behavior is 
important to their effectiveness. This means fostering communication 
"between persons" to set positive conditions for the actual communica- 
tion transactions. "Demonstrating enthusiasm in relating with others" 
(SCA/ATA Joint Task Force, 1978) fits here as a way to foster a healthy 
transactional climate. Remember, some of the state assessments empha- 
sized teacher enthusiasm and nonverbal communication as an important 
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dimension. Generally, the research into nonverbal codes and interpersonal 
relations would enlighten assessments in this phase especially. 

The next two component areas of the model (D and E) deal with the 
situations and types of interchanges that occur in education. Depending 
on who is involved at the moment, areas D and E would be involved 
alternatively. 

D. During-class instructional transactions. These are the complex 
interchanges of teacher and student that teachers must master. Skills 
herein pertain to the interplay of the modes of communication with the 
five functions of the transaction (Allen & Brown, 1976). The functions are 
the purposes of the specific instances of communication, the needs or 
intentions served. Although it is a rather distinct type, an instance could 
involve mixed functions. The modes refer to the particular nature of the 
speaking-listening activity occurring in the classroom (e.g., number involved 
and with how much interchanging of speaking roles). The modes tend to 
be presentational in focus (the teacher doing most of the talking) or more 
interactive in nature as in group or class interchanges. The modes of 
presenting focus on teacher-to-indivldual or teacher-to-class uses of lec- 
turing, giving directions, explaining, and! urally interpreting materials. The 
interacting modes involve competenci(;s from the research such as using 
questions, leading discussions, listening skills, feedback, and praise, with 
one student or an entire class. 

E. Extra-class transactions. These occur with (1) peers (fellow teach- 
ers in departments, committees, etc.); (2) professionals (in associations 
and conferences); (3) powers (principals, superintendents, etc.); and (4) 
parents (or guardians of students). Transactions with parents were con- 
sidered important in some of the state assessments reviewed by McCaleb. 
As in area D, one or more of the five functions would also pertain to the 
interchanges with these other parties. 

Other communication competencies reviewed in the first section of 
this chapter may also fit into the model. For example, all the skills iden- 
tified by the SCA/ATA Joint Task Force (1978) could be located in the 
relevant components of the teacher communication model. As an exam- 
ple, "demonstrating a sense of drama in story telling or reading aloud" 
clearly fits in category D, class presentations. 

Whatever set (or sets) of guidelines are used for the assessment of 
teacher communication, a coherent, organized conceptual model should 
be used to assure a valid holistic assessment. Since many states are 
involved in the national trend toward teacher testing, there is the danger 
that these efforts will not always follow conceptions that fit the realities 
of teaching. Equally dangerous is the possibility of assessments that yield 
an incomplete or fragmented picture of an individual teachers commu- 
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nication skills. It has been the intent of this chapter to help guard against 
such pitfalls by providing an overview of the domain of speech commu- 
nication in teaching and by synthesizing a coherent, holistic conception 
of teacher communication transactions. 
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"hen reading the two previous chapters, I recalled memories 
of a scene that took place more than 30 years ago. A young 
college student who sought admission to the preservice edu- 
cation m^or sat in a small room. He read aloud a selected 
passage to a single examiner who sat across the table from him. The 
examiner then asked the student some questions, made a few notations 
on a form, and dismissed the student. This scene was repeated many times 
for all students who sought admission to the "teaching mgjor." It was the 
speech test. Its purpose was to verify that teacher candidates were free 
of articulation, voice, and fluency disorders. 

We have come a long way from testing potential teachers for signs 
of speech problems to constructing models of teacher communication 
and assessing numerous communication competencies demonstrated by 
both preservice and inservice teachers. Today textbooks on classroom 
communication stress that the essence of teaching is communication; 
classroom communication differs from other communication situations 
in its purposes, environments, and participation forms; and teaching is 
informed by knowledge <bfthe communication process and by practice in 
implementing the process (Barker, 1982; Bassett & Smythe, 1979; Cooper, 
1984; Friedrich, Galvin, & Book, 1976; Hurt, Scott, & McCroskey, 1978; 
Klopf & Cambra, 1983; Seiler, Schuelke, & Lieb-Brilhart, 1984). Moreover, 
within the last decade, interdisciplinary research has focused on an inter- 
actional perspective of language use in the classroom, a perspective that 
examines patterns of teacher-student talk in order to understand how 
students learn and teachers teach through language. Underlying this research 
are assumptions such as the classroom is a unique communicative con- 
text, interaction in the classroom requires knowledge of pragmatic uses 
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of language and of classroom discourse rules, and students and teachers 
differ in their assumptions about appropriate communicative behavior in 
the classroom (Green, 1983; Morine-Dershimer, 1985; Tough, 1979; Wells 
& NichoUs, 1985; and Wilkinson, 1982). As Cazden (1987) notes, learning 
to talk for academic purposes forms part of a hidden curriculum through- 
out the school day. 

We have become increasingly precise in describing what happens in 
classrooms from a communicative standpoint, but we are less sure of 
what sfiouid happen. When we try to translate theory and research into 
practice, there is often a mismatch. As so often happens, theory and 
research do not answer some critical questions that practitioners face, so 
the practitioners forge ahead. This is the situation with oral communica- 
tion. The state of the art of teaching exceeds the state of the art of 
assessing speaking and listening skills. States that assess teachers* speak- 
ing and listening skills are charting new ground just as are states that 
assess students' oral communication skills (Backlund, \knRheenen, Moore, 
Parks, & Booth, 1981; Rubin & Mead, 1984), Those states that implement 
or plan to implement measures of oral communication should be com- 
mended for recognizing the importance of oral communication in teaching 
and learning and addressing assessment issues in a complex domain. 

The purpose of this chapter is to analyze the match between assess- 
ment practices that are described in chapter 1 and the conceptualization 
that Feezel describes in chapter 2. Two specific questions are addressed: 
(a) What perspectives on communication are stressed, and which are 
excluded? (b) What are some special problems of assessment in the oral 
communication domain? 



'eezeFs model of teacher communication stresses at least five key 



J. ideas: (1) Conununication in the classroom is transactional. (2) 
Teachers need knowledge about the communication process and confi- 
dence in communicating prior to engaging in instruction. (3) Communi- 
cation in the classroom is functional. (4) Some communication transac- 
tions require presentational skills, while others require interactive skills. 
(5) Teachers must be able to communicate effectively with different 
people who are involved in schooling. To what extent are these confirmed 
in assessment practices? 

Communication is Transactional 

There is a basic tension between the view typified in the model that 
communication is transactive and the view implemented in assessment 
practices that the teacher is a speaker or a listener. The transactional 
perspective means that teachers do not merely send information that is 
received intact by students. Rather, as teachers communicate with their 
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students, they simultaneously give information and, through feedback, 
receive information. In addition, teachers receive their own communica- 
tion; they listen to themselves. Therefore, teachers and students affect 
each other. Both share in creating and interpreting messages. Teacyiers 
change their communication behavior in response to what they perceive 
another person is communicating. 

Since teachers and students share in creating and interpreting mes- 
sages in the transactional perspective, the traditional distinction between 
teacher-as-speaker and teacher-as-listener fades. This distinction stresses 
a linear view of communication. Yet assessment practices emphasize these 
distinct roles and sets of skills. Note how listening is most often assessed 
through standardized tests, while speaking skills are tested separately 
through performance measures. Interactive communication is not assessed. 
In fact, from an examiner's viewpoint, interaction "muddies the waters" 
considerably; interaction does not make for tidy testing. Yet inside and 
outside the classroom the bulk of speaking and listening takes place 
during interaction. So transactive communication seems to be an area 
requiring vigorous test development efforts. 

One interactive teaching activity that has potential for assessment of 
communication skill in the classroom is the referential communication 
task. A speaker attempts to communicate with a listener about a target 
object, a referent, in a set of alternatives. The speaker's purpose might be 
to describe a picture or object so the listener can identify it in an array 
of similar pictures or objects. Or the speaker can explain how to constrict 
a model with blocks or give a series of directions to help the listener find 
a destination on a map. The speaker tries to inform the listener with 
accuracy and efficiency, while the listener seeks to demonstrate compre- 
hension in a goal-directed task. To be certain that the speaker and listener 
rely solely on verbal communication, they may not see each other; they 
communicate either back-to-back or across a table with a screen between 
them. 

Teachers can engage in such tasks with students, alternating their 
roles as speakers and listeners. The specific tasks have been derived from 
a research strategy (Glucksberg, Krauss, & Higgins, 1975) but have been 
adapted more recently for use in the classroom fDickson, 1981; Dickson 
& Patterson, 1981; McCaffrey, 1980). Since the tasks rely heavUy on infor- 
mative kinds of communication (describing, explaining, giving directions) 
and on modeling, interaction, and feedback to improve communication 
quality, they approximate transactive communication occurring in class- 
room instruction more closely than wholly separate measures. 

Knowledge and Confidence 

A second issue raised by the contrast between Feezers model and assess- 
ment practices is: What learning domains are being assessed? State prac- 
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tices stress performance assessment. Teachers are expected to demon- 
strate observable behaviors such as using oral language correctly; enun- 
ciating clearly, explaining effectively, or asking higher order questions. 
Communication skills are being assessed. This is correct when the pur- 
pose is to determine whether the teacher has ability to demonstrate 
appropriate communicative behavior in a given situation (McCroskey. 
1982). 

Note that FeezeFs model implies more than assessment of skills. The 
model is developmental because it suggests teachers need knowledge 
about the communication process as well as confidence in communicating 
prior to engaging in instructional transactions. Awareness of the com- 
munication situation is a cognitive behavior that requires relatively sophis- 
ticated analysis of who is speaking to whom, for what purpose, about 
what topic, and under what circumstances. The teacher is expected to 
understand the process of communication. This implies another form of 
assessment, one that measures the teacher's knowledge of communication 
theory. Knowled t'^e has a bearing on performance, but performance does 
not always reveal one's knowledge. Each complements the other, so there 
is a need to assess these different domains. 

Even more conspicuous is the model's emphasis on willingness to 
communicate and create a climate that fosters interpersonal communi- 
cation. Clearly, there is a significant affective dimension to classroom 
communication. One part of this dimension, communication apprehen- 
sion, bears directly on willingness to communicate and has been studied 
extensively (McCroskey, 1977). Not to be confused with fear of public 
speaking or "stagefright," communication apprehension is fear of real or 
anticipated communication encounters in both informal and formal situ- 
ations. This fear is so great that the person avoids communicating when- 
ever possible. Some research suggests that 20% of classroom teachers 
suffer communication apprehension, with more experiencing the problem 
in elementary than in secondary schools (McCroskey, 1977). Communi- 
catively apprehensive teachers gravitate to lower grades; apparently they 
perceive teaching children as less threatening than teaching adolescents. 

Fortunately, some measures are readily available to assess commu- 
nication apprehension. The Verbal Activity Scale is one self-report mea- 
sure that indicates normal verbal activity, while the Personal Report of 
Communication Apprehension reveals level of communication apprehen- 
sion (McCroskey, 1977). IdeaUy, such measures would be employed early 
in preservice teacher preparation programs. 

Assessment needs to recognize that a teacher's success depends on 
communication performance in the classroom. Underiyir. g performance should 
be a knowledge base that can support communicating in more situations 
than can be observed in a single assessment and an attitude that reflects 
willingness to communicate and confidence in. communicating. 
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A Range of Communication Situations 

In the third, fourth, and fifth points summarized earlier, Feezel's model 
emphasizes that teachers communicate in a range of situations. These 
situations occur in moments of instructional transaction as well as in 
extra-class exchanges and are defined by different functions, forms (or 
what Feezel calls "modes") » and audiences. 

The five communication functions that Feezel cites are derived from 
research on communication development (Wells, 1973) and have been 
applied in classroom activities (Allen, Brown, & Yatvin, 1986; Wood, 1977a, 
1977b). The functions imply that the teacher must possess and be able to 
draw from a repertoire of communication acts. Convincing parents, per- 
suading a school administrator, praising and encouraging students, 
explaining information, facilitating social interaction, role-playing a prob- 
lem in class, speculating about a solution, and other similar acts are 
required daily But by emphasizing explaining and questioning acts, assess- 
ment practices stress one function, informing. An exception is the few 
states that assess giving directions, which stresses the controlling func- 
tion. Evaluators, then, need to consider how important other communi- 
cation functions are and how those functions can be assessed. 

Multiple forms of communication also need to be assessed. Teacheis 
must be able to conduct one-on-one conferences and interviews, lectur e 
to a class, read materials aloud, lead class discussions, organize small- 
group tasks, ask questions, and respond to answers. Feezel notes that 
some of these forms require presentational skills and others interactive 
skills. But presentational forms dominate in assessment practices. Of the 
12 competency categories that are assessed, 3 stress the interactive skills 
of feedback, questioning, and using student ideas. Seven categories point 
to an emphasis on presentational speaking: oral language usage, speech 
mechanics, fluency, explaining, directing, emphasis and enthusiasm, and 
nonverbal cues. 

Research in presentational speaking (Becker, 1962; Price, 1964) has 
exhibited relative consistency in evaluation criteria. Although speech 
rating scales might contain at least 1 1 items, raters make only a limited 
number of judgments that cluster around a few general aspects of pre- 
sentation such as language, delivery, content, and organization. Language 
and delivery skills (mechanics, fluency, enthusiasm) appear to be stressed 
more in assessment practices than matters of content and organization 
such as making key ideas clear, supporting ideas with appropriate exam- 
ples and data, adhering to the topic, and conveying ideas in an understand- 
able order 

Communication with students is spotlighted in assessment practices 
although teachers need to be able to communicate with other audiences 
such as parents, peers, administrators, and professional leaders. The class- 
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room is the primary assessment arena. Thus assessment practices sample 
only part of the range of communication situations the teacher faces. A 
particular view of teacher communication tliat emerges is: The teacher's 
primary function is to disseminate information tlirough presentational 
speaking to a student audience. States that plan to assess teacher-parent 
communication bear watching, though, for they may discover ways to 
assess communication in larger school and community contexts. 



For Further Consideration 

As teacher education programs and state agencies continue to explore 
ways to assess oral communication, further consideration needs to be 
given to the level of communication skills that is the focus of assessment, 
ways teachers use language in teaching, and importance of role taking 
and audience analysis. 

First, a distinction must be made in the levels of skills that are the 
focus of assessment. Competencies are stated in behavioral terms and 
assessed as skills through performance measures. Following analyses of 
Polanyi (1964), Scheffler (1965), and Cazden (1972), instruction and 
assessment can focus on two skill levels: facilities and critical skills. 
Facilities are subsidiary in awareness to critical skills, which demand our 
focal attention. Thus facilities are components of and serve higher order 
critical skills. From the list discussed in chapter 1, facilities include speak- 
ing clearly at an appropriate pace and volume, using grammar correctly, 
using correct vowel/consonant/diphthong sounds, varying vocal intensity 
and rate, and speaking fluently Critical skills include explaining, ques- 
tioning, and giving directions. 

Evaluators have to decide at what level to focus assessment. Should 
the focus be on particular facilities, as it appears to be in some schemes, 
or should it be on critical skills? By focusing on functional tasks — giving 
directions, persuading, narrating, describing, explaining — severpi fa. ili- 
ties can be assessed and strengthened simultaneously, not as ciiu in 
themselves, but as behaviors that are instrumental in accomplishing a 
larger instructional goal. 

Second, teacher educators and evaluators must consider the role of 
language in teaching. Assessment practices appear to stress one aspect 
of language, correct usage. But there are other ways to observe the role 
of language in education. Teachers need to recognize and use language 
as an instrument for learning. This implies reducing the gulf between 
students' language and the language of textbooks (Olson, 1981) and teach- 
ers (Barnes, Britton, & Rosen, 1969); According to Barnes et al. (1969), 
this gulf stems, at least in part, from specialist language and the language 
of education. Specialist language refers to vocabulary that is inherent in 
learning a subject. To learn mathematics students must master concepts 




such as "parallel" and "multiples*'; in music, terms such as "pitch," "treble 
clef," and "embouchure" must be mastered; and in English, students must 
learn "homonyms," "stanza," "meter," and "onomatopoeia." For the stu- 
dent, learning a subject involves comprehending and using the subject's 
vocabulary. 

The language of education refers to expository language used by the 
teacher but not specific to any school subject. For example, the teacher 
says, "The point I want to make is . . " or "It is still quite apparent today 

that " Here language serves a sociocultural function by identifying the 

speaker's role as teacher and relationship to listener as voice of authority. 
At other times the teacher says, ""The position o/line A in relation to line 
B . . " or asks, "What two things do tliese examples have in common?' 
This language serves a conceptual function; the italicized phrases carry 
essential thought processes of the lesson. 

Teachers use language to support their instructional role and to 
perform conceptual functions. Both purposes occur together for the teacher, 
but for students the teachor's language first has a sociocultural function. 
Students understand the teacher's talk as "the kind of thing my teacher 
says." For students, language serves the conceptual function only after 
they can use the language in their thinking, talking, and vmting. To learn 
through language, students must do their own telling, asking, classifying, 
ordei* g, explaining, narrating, and recording. 

From an assessment standpoint, evaluators can look beyond the 
teacher's grammar to specialist uses of language and the language of 
education. Are teachers aware of these uses? Do teachers take steps to 
help students understand these uses? A "yes" to both questions would 
help solve many of the communication problems that occur in classrooms. 

Third, assessment should consider role taking, a process that is instru- 
mental to effective and appropriate communication. Not to be confused with 
role playing, which involves overtly enacting the attributes of another person, 
role taking is a covert, cognitive process. Role taking involves apprehending 
and understanding critical attributes of our listeners or audience. These 
attributes include the listeners knowledge and experience with the subject; 
factors that might influence the listener to understand or not understand 
our message and agree or disagree; the listener's mood, age, and sex; and 
the listenerls motivations, attitudes, and beliefs. 

Flavell, Botkins, Fry Jr., Wright, and Jands (1975) have identified five 
cognitive requisites to role taking. Speakeis need to know: other Jjeople's 
perceptions, thoughts, and feelings differ from their own; it is useful to 
analyze the other person's attributes in order to realize their own goal; 
how to analyze accurately and predict the most important attributes; how 
to remember these attributes, considering one's goal and viewpoint; and 
how^ to translate into an effective message what they know about the 
other person's attributes. 
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I am not suggesting that role taking should be the object of assess- 
ment. Role taking serves and is manifested in audience analysis, which in 
turn results in adapted communication. Yet, this process does not appear 
to be prominent in assessment practices. Perhaps some evidence exists 
in pedagogical conten: knov^rledge, the ability to organize and interpret 
content so students can understand. But the process deserves to be more 
prominent because it is essential for knowing how to gain and maintain 
students' attention, connecting new ideas with students' previous knowl- 
edge and experience, elaborating and clarifying msyor ideas, relat . ate- 
rials to students' cultural and ethnic backgrounds, and choosing lang^iage 
that is readily understood. To teach effectively, teachers must engage in 
role taking and adapt to their students' perspectives. 



he assessment process merits attention in oral communication. In 



A the past five years there have been at least five reviews of oral 
communication assessment instruments (Backlund, VanRheenan, Moore, 
Parks, & Booth, 1981; Brown, Backlund, Gurry, & Jandt, 1979; Larson, 
Backlund, Redmond, & Barbour, 1978; Rubin & Mead, 1984; Rubin, Sisco, 
Moore, & Quianthy, 1983). While many of these instruments are for use 
with students, Iheir development informs teacher assessment. There is 
no dearth of measures for assessing different aspects of oral communi- 
cation, and there is no aspect of ftmctional communication for which 
measurement problems are prohibitive (Larson, 1978). But there are prob- 
lems. Rubin and Mead (1984) identify 28 research and development prior- 
ities. Space limitations prohibit discussion of all these priorities, but a 
few pertaining to teacher assessment need to be presented briefly. 



First, there appears to be little consensus on a conception of oral com- 
munication competence that guides assessment. In chapter 1 McCaleb 
exposes some communication competencies that are incorporated within 
other domains such as subject knowledge, diversity of instructional method, 
and classroom management. Where, for example, does classroom man- 
agement end and effective communication begin? Larson (1978) suggests 
that the lack of conceptual clarity is the greatest long-run impediment 
facing communication assessment. Second, we need comprehensive sur- 
veys of objectives in courses on instructional or classroom communica- 
tion. Third, if we have a common conception and common objectives 
there is still a need to decide how to best sample the oral communication 
domain. Situations that are commonly taught in some classes such as 
giving a speech, reading aloud, or participating in and leading a discussion, 
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are not equivalent. Fourth, dear evaluation criteria need to be established. 
Assessment practices vaiy in the way they define and weight criteria such 
as oral language, speech mechanics, or content and organization. Fifth, 
given adequate sampling and clear evaluation criteria, there is a need to 
establish how well performance in assessment situations coincides with 
performance in daily classroom instruction. 

Reliability 

Three reliability issues are evident. First, it is unclear whether teachers 
are evaluated by different observers and, if so, whether there is a high 
degree of agreement among observers. Training aimed at calibrating 
observers needs to be an integral part of assessment programs. A second 
issue is equivalence of topics and tasks. Some assessment situations vary 
the discourse topic and task without establishing equivalence. For exam- 
ple, how is a teacher's performance in explaining how to make an object 
related to performance in asking questions or in telling a personal nar- 
rative? Third, to what extent is *'test-retest" reliability sought? How many 
times is a teacher observed in order to determine oral communication 
proficiency? How many samples of communication are used? 

Bias 

Stiggins (1981) notes that care must be taken to deal with potential 
sources of bias in assessment because patterns of oral communication 
are greatly affected by divergent linguistic and cultural factors. One pos- 
sible bias source is the assessment situation. Is it familiar and comfortable 
for the teacher and students? The physical surroundings and the race, 
sex, and manner of the evaluator, particularly in a face-to-face oral com- 
munication situation, can affect the behaviors of the teachers and students 
who are being observed. Also, bias can arise when evaluators' judgments 
are influenced more by their social attitudes and experiences than by 
clear rating criteria and standards, particularly in assessment of speaking 
performance. Stiggins (1981) emphasizes that performance tests must be 
developed by persons knowledgeable about and sensitive to the cultural 
and social experiences and traditions of the persons to be tested. 

Feasibilv y 

Beyond issues of validity, reliability, and bias is the matter of cost. Cost 
translates into feasibility. Even when state assessment projects recognize 
the importance of oral communication skills and want to pursue assess- 
ment, they may lack the necessary resources. Many speech performance 
me;=.5ures require individual administrations. Listening assessment requires 
tape recorded instructions and response options. Compared with presum- 
ably more efficient group administered written tests, oral communication 
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measures can seem less feasible. So there is a need to develop cost-benefit 
analyses — cost in terms of time, money, and equipment, and benefit in 
terms of the assessment's effect on teacher performance and classroom 
practice. 

In summary, the assessment of teachers' basic communication skills 
is a complex process that must consider the transactive nature of com- 
munication, evidence of the teachers underlying knowledge and affective 
behaviors as well as performsmce skills, the teacher's ability tc coirmu- 
nicate functionally in a range of situations, the level ofskill to be assessed, 
the role of language in learning, and the importance of adapted commu- 
nication. In addition, assessment in the oral communication domain must 
address validity, reliability, bias, and feasibility issues. 

Let us not forget that assessment is a communication process. Assess- 
ment can be used to certify proficiency among individual teachers. But 
more important, assessment should be used as a constructive tool that 
informs teachers, improves their communication behavior, and results in 
positive effects on classroom practices. 
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Research Base for Assessing 
Communication Skills 
of Teachers 
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he research base for evaluating teachers* communication skills 
comes from two areas. Process-product research (attempts to 
link teacher behavior to student achievement) and associated 
principles of direct instruction (e.g., teacher explicit instruction 
of concepts and principles to be learned) comprise one area. The second 
is speech communication research. The criteria often are stated in behav- 
ioral terms so they can be easily observed and quantified. While the 
findings of process-product, direct instruction, and speech communica- 
tion research are important and should be considered when evaluating 
teachers* communication skills, they have limitations for teacher assess- 
ment. Furthermore, some of the most recent research on effective instruc- 
tion suggests that additional communication skills, more subtle and fluid 
than those emphasized on current assessment instruments, are much 
more important than what is included on behavioral checklists. This 
chapter summarizes the results of early research and their limitations for 
teacher assessment, contrasts those findings with recent research, which 
suggests more subtle communication skills play a crucial role in effective 
teaching, and raises cautions about the assessment of teachers* commu- 
nication skills. 

A CRITIQUE OF THE RESEARCH BASE OF 
CURRENT ASSESSMENT EFFORTS 

The research base of current assessment efforts can be divided into 
two sections: results from research on teaching and results from 
•Coauthors listed in alphabetical order. 

• I. 
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speech communication studies. We have concerns regarding how both 
are applied to teacher evaluation. 

Critique of Research on Teaching Findings 

Knov^rledge about pedagogy has increased in the last 15 years. Much of 
this research has been summarized by Brophy and Good (1986). Although 
it is unnecessary to repeat what these authors have so thoroughly docu- 
mented, we will briefly highlight some of the msyor findings and our 
concerns about the use of these findings in teacher evaluation instru- 
ments. 

Our first concern is that behavioral checklists do not accurately 
reflec t the complex data obtained from research on teaching. For example , 
teacher questioning has received much attention vdth Brophy and Good 
(1986) discussing: 1) difficulty level of questions; 2) cognitive level of 
questions; 3) clarity of questions; 4) post-question wait time; 5) selecting 
the respondent; 6) waiting for the student to respond; 7) reactions to 
correct responses; 8) reacting to partly correct responses; 9) reacting to 
incorrect responses; and 10) reacting to students' questions and com- 
ments. By tran^slating such a complex set of findings into discrete items 
about questioning on a checklist, there is the danger that the complexity 
and interactions vnR be masked and false conclusions about teachers' 
effectiveness will result. 

Second, we are concerned that research on teaching findings is being 
used in teacher assessment instruments without appropriate regard for 
context. For example, Evertson, Anderson, Anderson, and Brophy (1980), 
Evertson, Anderson, and Brophy (1978), and Evertson, Emmer, and Bro- 
phy (1980) examined how findings apply differently at various grade 
levels. In summarizing this research, Brophy and Good (1986) state, *'Most 
findings must be qualified by grade level, type of objective, type of student, 
and other context factors" (p. 366). Thus, the evaluative criteria, while 
grounded in teacher behaviors that research says make a difference in 
student learning, are sometimes inappropriately applied to various grade 
levels or contexts. This seems to be a serious limitation in current assess- 
ment instruments. 

Third, we are concerned that findings are applied to teacher assess- 
ment instruments without regard for the curricular outcome. For example, 
the value of structuring lessons and actively involving students through 
the use of questions was documented in a series of studies done at the 
University of Canterbury in New Zealand (Hughes, 1973; Nuthall& Church, 
1973; Wright & NuthaU, 1970). SimUarly, Stallings et al. (1974, 1977, 1978) 
found achievement gains to be positively associated with active group 
instruction in the subject matter; and Anderson, Evertson, and Brophy 
(1979) developed principles for organizing, managing, and instructing 
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gi-oup reading sessions. All these findings, however, focused on basic skills 
achievement as measured by achievement tests. They may be less appro- 
priate when the curricular outcomes are conceptual or aesthetic under- 
standings. Current teacher assessment instruments, however, do not make 
such curricular di^3tinctions. 

Griii cii:? of Speech Conununication Research 

We have similar concerns regarding speech communication research. Of 
the several communication categories identified by McCaleb in chapter 
1, oral language usage and speech mechanics can be combined. Those 
factors, while important, are insufficient for learning to occur. Students 
must be able to hear and understand a teacher to learn, but hearing and 
understanding a teacher do not assure that learning will occur. Regarding 
correct language usage, one may argue that the teacher is a powerful role 
model for students and that improper language usage may teach students 
poor grammar or poor expression. Such language usage, however, does 
not necessarily interfere with the students' ability to learn the content. 
Improper language use may influence the teachers' credibility with high 
school students and thus interfere with the teachers effectiveness but, 
again, these qualities are not necessarily linked to student learning. 

We also are concerned with the category of "enthusiasm" or refer- 
ences to the teacher conmiunicating subject matter information with 
confidence and authority. The topic of ethos or source credibility- has been 
discussed by communication researchers and scholars since the days of 
Aristotle and has been recently defined, in part, as dynamism (McCroskey, 
1968). Such enthusiasm or dynamism may build a teacher's credibility or 
the students' perception of the teacher's effectiveness. Studies by Norton 
(1983) link characteristics of a dynamic teaching style, which may include 
an enthusiastic delivery, with students' perceptions of teachers' effective- 
ness. As Brophy and Good (1986) state, "Enthusiasm, usually measured 
by high inference ratings, appears to be more related to affective than tc 
cognitive outcomes" (p. 362). Thus, teacher assessment instruments that 
include the criteria of teacher enthusiasm may be contributing to positive 
affect, but not necessarily to increased achievement. We concur with the 
Georgia assessment that cautions enthusiasm alone is insufficient for 
effective instruction. 

Summary of Critique of Research Base 

The effective teaching research has emphasized overt teacher behaviors 
and task engagement. For instance, Brophy and Good (1986) reported 
that many teacher effectiveness findings focus on control of pupil behav- 
ior and learning tasks. Effective teachers select certain tasks for students 
to pursue and ensure that students concentrate on these tasks during 
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instruction. Hence, quantity and pacing of instruction gets emphasized, 
and the teacher's role as an active supervisor of students' task completion 
efforts is stressed. Instruction is conceptualized in terms of the lesson, 
with instructional functions limited to sequential lesson events such as 
review, presentation, guided practice, feedback, and independent practice 
(Good & Grouws, 1979; Rosenshine & Stevens, 1984). Within the lesson, 
emphasis is on being explicit, clear, specific, and structured, and a heavy 
emphasis is on questioning in a recitation mode (Brophy & Good, 1986; 
Rosenshine & Stevens, 1984). Such findings cannot be applied to teacher 
evaluation as if these factors do not interact and there are no context 
effects nor can they be applied equally to all curricular outcomes. Simi- 
larly, the speech communication research has emphasized overt traits 
such as speech patterns and enthusiasm. These, too, are important, but 
they are insufficient for evaluating teacher performance. 



here is no question about the importance of student engagement on 



JL task and structuring the lesson appropriately, necessity for being 
specific and explicit during the lesson, or desirability for proper language 
usage and enthusiasm. When evaluating teachers' communication skills, 
these criteria must be included. Some recent research, however, suggests 
that these necessary criteria are iiisufficient to achieve the most effective 
instruction. A series of studies on teacher effectiveness during reading 
instruction (Duffy, Roehler, & Wesselman, 1985) serve as an example. 

Two conflicting sets of research findings triggered the reading 
instruction studies. First, recent research on reading emphasizes the need 
for readers to be strategic, that is, systematic and deliberate in ^plying 
skills in decoding and making sense of the text. Second, studies of prac- 
tices employed by teachers indicated that the teaching of mental acts 
associated with strategic reading were seldom emphasized during class- 
room instruction (Dufiy & Mclntyre, 1982; Durkin, 1978-79). Instead, 
classroom practice studies reveeded an emphasis on student engagement 
on task and structured lesson sequences such as those found in the 
effectiveness teaching research. There was a heavy emphasis on step-by- 
step questioning procedures, which focus students on task completion 
rather than mental acts involved in being strategic. As a result, students 
were left to infer these mental processes. 

Consequently, the studies were initiated to determine whether stu- 
dent awareness of how to use skills and ability to read would increase if 
teachers were explicit in explaining the reason involved in using reading 
skills as strategies. For example, assume a teacher was teaching the 
reading skill "compound words." The teacher's guide recommended directing 
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students to complete a worksheetby drawing lines between the two words 
in Uie compound and to say the word. To explain the strategic reasoning, 
the teacher would 1) identiiy a forthcoming reading situation in which 
students will find an unknown compound word; 2) teach students to stop 
reading when they recognize the word is unknown; 3) show them how to 
search their repertoire of strategies for one that can be used to identify 
the unknown word; and 4) make statements about how to seek recogniz- 
able word parts, combine mentally the meaning of the two words, and 
think about the combined meaning to determine whether it makes sense 
in the text. 

Two descriptive and two experimental studies were conducted over 
a four-year period. The results indicate that when teachers explicitly 
explain mental acts associated with using skills as strategies students are 
more aware and achieve better tiian when only task engagement and 
lesson structure are emphasized (Roehler, Duffy, Putnam, Wesselman, 
Sivan, Rackliffe, Book, Meloth, & \^vrus, 1986; Duffy, Roehler, & Wessel- 
man, 1985). In addition, post hoc qualitative analysis of the most effective 
teachers suggests that evaluations of teacher communication skills need 
to go beyond the task involvement and lesson structure elements currently 
emphasized (Duffy, Roehler, & Rackliffe, 1986), Three examples, which 
reflect a more subtle and fluid concept of. instructional communication 
than what is traditionally found in the leacher effectiveness research, 
follow 

Modeling and Responsive Inlerfi' ' fo. 

Virtually all literature on effective tea^hl' mphasizes the need to dem- 
onstrate for students and interact \\ith th Most of the emphasis, how- 
ever, is on giving directions to complete tasks and feedback regarding the 
correctness or incorrectness of student responses. 

It is important for teachers to know that students understand how 
to follow directions and that they receive feedback on the correctness of 
their responses. The most effective teachers go beyond these behaviors 
during instruction. They focus on making visible the thinking involved in 
completing the task rather than just the overt steps to be followed. They 
listen to students* responses to decide what additional modeling of the 
mental processing is required as well as to provide feedback about cor- 
rectness and incorrectness. 

Consequently, the more effective teachers focus on communicating 
information about the thinking processes involved rather than only the 
steps required to complete the worksheet or skill page. This communi- 
cation requires a spontaneity and responsiveness that goes beyond the 
presentation of prepared models and demonstrations. Teachers mod"' 
and then ask students to perform the same task in order to determine 
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whether the students employ appropriate reasoning. The teacher observes 
the students' reasoning. If the responses indicate misunderstandings, the 
teacher goes beyond corrective feedback by providing reexplanations and 
elaborations desij^ned to bring students closer to the desired understand- 
ing. This interactive cycle is the heait of instruction where the teacher 
mediates the students' responses to decide what needs to be explained 
next and students mediate the teachers elaborations to decide how to 
modify their understandings. 

During this series of interactions, which occur over time, students 
are moved from what Vygotskey (1978) calls "other-directed to self-directed'' 
in their understanding and use of what is being taught. How quickly or 
how slowly the teacher moves the student toward the "self-directed" mode 
and what the teacher says ar^d does to expedite this movement are fluid 
and tentative endeavors. 

The communication required here is more sophisticated than what 
iS normally discussed in the traditional teacher effectiveness research. It 
requires a spontaneity, sensitivity to students' mental processes, and a 
fluidity that is much more characteristic of conversation than of tradi- 
tional lessons. This essence of instructional communication should be 
assessed but rarely is. It illustrates the concept of communication as a 
"transactional, symbolic process" (Miller, 1980). The transactional approach 
is consistent with the perspective of communication as the process of 
sharing moaning. 

Achieving Conceptual Consistency 

Ways in which ^ most effective teachers achieve a conceptual consis- 
tency in their ■ ing provide a second illustration of how effective 
instructional cl- ' /cation is more subtle than previously thought. The 
most effective tea*. : . . are explicit and structured during lessons, and 
they are explicit and structured about the same thing in every lesson. 
They communicate to students a consistent message. Instruction acquires 
a cohesive element in an individual lesson and in many lessons taught 
across the academic year. 

One example of this instructional characteristic is the way in which 
effective teachers communicate the usefulness of instructional content. 
In the study of teaching skills as strategies cited above, effective teachers 
informed students when the skill being taught would be used, the problem 
the skill would solve, and why the skill should be learned. More important, 
:hey gave the same message during every lesson. Whether the skill being 
taught was phonics or main idea, the effective teachers typically began 
lessons by showing students examples of when they could use that skill. 
Thus, the teachers consistently reinforced the concept that skills were to 
be used to solve problems encountered in reading. 
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Such conceptual consistency brings a glue to instruction and combats 
the tendency to teach lesson content in isolated chunks. When conceptual 
understandings are consistently presented and applied in similar ways, 
the instruction assumes a level of meaningfulness that enhances effec- 
tiveness. This important aspect of instructional communication is found 
infrequently in teacher assessment instruments. 

The Longitudinal Aspect of Instruction 

A third subtle aspect of instruction is that teaching takes time. Seldom is 
the instructional issue settled in a single lesson 

In the studies used for illustration, a mpjor outcome measure was 
student interviews following lessons. During these interviews, students 
were asked to tell what skill was being taught and when and how to use 
the skill. Lessons were observed at intervals year-round, and teachers' 
explanations and students' responses to interviews were monitored. 
Teachers who had been taught how to improve their instructional expla- 
nations about using reading skills showed immediate and statistically 
significant improvement in these explanations duiing the Fall of the aca- 
demic year. Their students, however, showed no significant growth in 
lesson content awareness until February because tliey construct meaning 
gradually. As Doyle (1983) and Winne and Marx (1982) note, students 
"mediate" instructional information, using their unique background 
knowledge to constmct understandings about what they are supposed to 
learn. Thus, students do not learn immediately what the teacher intends. 
Instead, they gradually restructure instructional information and build 
appropriate understandings over time. Learning seldom occurs in a single 
lesson, but most teacher assessment instruments are designed to be used 
in single, isolated observations. 

Sununary of New Research Directions 

The overt and behavioral characteristics of effective teaching such as 
those associated with student engagement on task, lesson structure, lan- 
guage usage, and enthusiasm are important to note when examining 
teachers' communication skills. More recent research, however, suggests 
that instruction is a more subtle and fluid endeavor than implied in the 
earlier teaching and speech communication findings. Those findings may 
lead to necessary but insufficient criteria for effective instructional com- 
munication. This recent research suggests that instructional communi- 
cation requires a sensitivity to student understandings as well as to their 
answers. There should be an ability to respond to misunderstandings with 
spontaneous elaborations and clarifications. Instructional communication 
requires a conceptual linking of the individual lessons so a consistency 
and cohesion is brought to instruction. It requires time because student 
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learning is a process of gradually con^^vtructing knowledge. These lindings 
put teachers' conimunication skills in a new light and have in^plications 
for the focus of assessment efforts. 



ny assessment instrument has an ideal image, or concept, of the 



-iTjLperson or thing being measured. Statewide assessments of teachers' 
communication competencies also have images or concepts of an effec- 
tive teacher We recognize that the definition of an effective teacher may 
be based on several factors including such items as: 1) a perception held 
by students, principals, parents, or colleagues of teachers' effectiveness; 
2) the teacher's ability to enhance the positive self-concept of learners 
and their affective development; 3) the ability to build a social climate in 
the classroom to enhance the learning of s*;udents in groups; 4) the ability 
to promote appreciation for diversity within a student populatior.^; 5) the 
ability to effectively manage the classroom to avoid disruptions. We also 
recognize that teachers can be taught to engage in effective communica- 
tion behaviors resulting in positive student achievement (Roehler, et. al. 
1986). Teacher assessment instruments have potential value for strength- 
ening teacher communication behavior because they focus on effective 
teaching behaviors and provide guidelines for improving teaching. The 
extent to which such assessment instruments can enhance teachers' and 
administi .:Rors' awareness of a pedagogical knowledge base is beneficial. 

Cautions are required, however. Brophy and Good (1986) list signifi- 
cant reasons for not translating research findings on teacher behavior and 
student achievement into a teacher assessment instrument, stating "there 
may be different but functionally equivalent paths to the same outcome^' 
(p. 366). Effective teaching behaviors may not be structured or ordered 
in the exact way that emerged from the research. Brophy and Good (1986) 
also emphasize that their teacher behavior research review provides evi- 
dence of academic achievement only. Thus the findin^fjs do not include 
other teacher objectives such as "fostering positive JiiUitudes, personal 
development, and good group relations" (p. 36f)). These authors note that 
teachers have multiple goals when teaching rather than just acW-^^vement; 
data jfrom many of the process-product studies come fi-om a itionally 
taught classrooms; and "most findings must be qualified by ^ ade level, 
type of objective, type of student, and other context factorb'^ Cp. 366). 
Thus, states that have developed asses:^/5\ent instruments based on pro- 
cess-product research need to be cautioned about applying those findings 
to a heterogeneous mix of students being taught multiple objectives in 
the context of the sometimes competing demands of the classroom. 

We also are concerned about the use of assessment instruments that 
are theoretically defensible because they are based on research findings. 



CONCLUSION 
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First, open-ended instruments are highly dependent on observers' per- 
ceptions, understanding of effective communication, and attentiveness to 
communication detail in the classroom. Observers can be trained, but the 
weakness of relying solely on observer perceptions creates potential 
disadvantages for teacher^;. Second, behavior checklists are limited. They 
assume a one-to-one correspondence between teacher behavior and stu- 
dent achievement that may not exist. The teaching-learning piocess is a 
more complex, dynamic, interactive process than tlie behavior checklist 
suggests. As Hermann (1986) notes, there is a danger that the qualitative 
dimensions of instruction will be ignored. Third, a question is raised 
regarding how much of a certain behavior must be lacking in order to 
make a teacher ineffective. The assessment instruments that provide 
uniform weighting of criteria may negate the importance of the accuracy 
of information being presented. 

We urge educators to continue participating in the development of 
the pedagogical knowledge base by (1) systematically reviewing the effect 
of their communication behaviors in the classroom and documenting 
changes that they make in affecting student learning and by (2) supporting 
researchers who wish to do naturalistic studies in their classrooms. Only 
through systematic and sustained effort to understand the phenomena of 
effective instruction and the effects of teacher behavior on student 
achievement will we be able to more systematically prepare teachers to 
be professional educators. Meanwhile, we must guard against a misuse 
of the research base and the simplistic diluting of findings to fit an assess- 
ment purpose. 
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Exercise in 
Misconimunication? 
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everal years ago many speech department offices were decorated 
with a poster reading, "I know that you think that you heard what 
I said, but I am not certain that what you heard is wi:at i really 
meant." This protest over disparity between the stated and the 
intended is quite likely to be echoed in many administrative offices and 
classrooms as state-mandated assessments of teachers acquire varying 
meanings with each assessment setting and assessor. Assessments have 
attempted to define measures of competence — and even excellence — for 
all teachers of all subject matters at all grade levels. It would be naive to 
assume that a mandated policy will not acquire differential interpretations 
as it is diffused througliout districts and schools. In chapter 4 Book and 
Di>ifiy discussed the problematic nature of misusing research findings to 
assess teachers' communication skills. They considered recent research 
on students' thought processes that mediate instruction. This chapter will 
build on their discussion to explore the potential miscommunications to 
teachers and the general public that may result from current assessment 
policies. 

GENERIC TEACHING BEHAVIORS 

Jn an attempt to contro] the quality of teaching and, in several states, 
to reward those teachers who exhibit excellence, the assessors have 
attempted to interpret "good'' or "competeni'* teaching. With the excep- 
tion of written tests of subject matter, the assessments discussed by 





McCaleb in chapter 1 are deliberately generic in nature. They evaluate all 
teachers with identical instruments, reducing the potential for district or 
school biases and permitting comparisons among teachers. This compar- 
ative view is particularly important in states such as Texas where the 
assessment is directly tied to a career ladder and merit pay The clear 
implication is that a competent life science teacher in rural Splendora, 
Texas, will behave similarly to a competent bilingual first-grade teacher 
in El Paso. 

Let us pause for a moment and reflect on this situation with specific 
reference to communication skills. McCaleb summarized the communi- 
cation measures into 12 categories: correctness, speech mechanics, fluency, 
feedback, knowledge of subject matter, explaining, enthusiasm and non- 
verbal communication, questioning, giving of directions, emphasis, inter- 
action with learners, and interaction with parents. Together these cate- 
gories suggest that teachers who are skilled classroom communicators 
are knowledgeable, fluent speakers who are also skilled in interpersonal 
relations. On the surface, one can find little to argue against this picture 
of a teacher The goals expressed by the assessments are well intended 
and the designers undoubtedly have grappled with defining a good com- 
municator As the documents are interpreted and amplified by those 
charged with implementing the assessments, it is important to consider 
the implicit communications that accompany the efforts to identify and 
reward quality in teaching. Otherwise, the assessors may be identifying 
and rewarding something quite different. 

Generic teaching behaviors may not produce goal-specific learning. 
In their attempt to develop instruments to be used with all teachers, many 
designers have consulted with researchers on effective teaching and have 
paid close attention to process-product research. This research on teach- 
ing that studies the relationships between what teachers do and the 
outcomes of their students (summarized in Brophy & Good, 1986 and in 
Rosenshine & Stevens, 1986} ^ s identified specific verbal behaviors that 
tend to increase children's scores on standardized reading and math tests. 
The process-product research has provided educators with a set of prac- 
tices that are especially useful for enabling students to work through well- 
structured problems that have correct solutions and lend themselves 
easily to criterion performance measures. These practices are also useful 
for helping students develop skills that can be divided into related sub- 
skills. They are not applicable, however, for developing the ability to solve 
ill-structured problems, which have no single answer, or for developing 
creative thinking or creative expression (Rosenshine & Stevens, 1986). 
Book and Dili's critique of the process-product base for assessing com- 
munication in chapter 4 indicates that teachers often emphasize task 
completion instead of developing specific mental strategies. Thus, explicit 
links between mental activity and task outcome are nonexistent. Teachers 
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can only hope that students will infer those links as a result of task 
completion. 



hile the intent to formulate assessments grounded in research on 



V V teaching is commendable, there exists the potentially dangerous 
miscommunication that research has identified behaviors that teachers 
can follow to guarantee successful teaching. This message, found in the 
phrase "research says/' is communicated overtly and covertly in presen- 
tations at professional conferences, training sessions that certify observ- 
ers and administrators to make the assessments, and briefing sessions for 
teachers. Th^ phrase is unaccompanied by qualifications identified by the 
res'^archers or c ritiques of the research offered by reviewers. 

The prc^e&s-product research, and hence the assessn ( iit rastrument, 
is geneticaviy fo'juyed as opposed to subject matter foc.^ ./ed. Context 
specific situations and the educational purposes that the instruction may 
be designed to sen^e are ignored. There a growing research base on 
teaching and effective ;.;sroom communication, but that research is 
a guide for practice rather than a mandate. It is difficult to compare 
teachers who routinely employ teaching methods that are more student 
centered and less teacher centered such as creative dramatics, field games 
in physical education, and inquiry-oriented science programs. Such teach- 
ers may depend less on presentation£d communications and more on 
interactive communication. In these instructional settings the teacher is 
less concerned with feedback on "correct" performance and more con- 
cerned with challenging, probing, and guiding students toward a qualita- 
tive goal of excellence rather than a quantitative goal of test performance. 
In a search for comparability it is possible that assessments may be 
sacrificing individual variety and experimentation. The second potential 
for miscommunication here is that administrators or teachers may limit 
the universe of desirable communication skills to those being assessed, 
thereby legitimating only those educational purposes that can be readily 
assessed by current instrumentation. 

A third potential miscommunication resulting from the use of generic 
instruments is that subject matter is not a consideration when evaluating 
teaching. For example, in the category that McCaleb identified as feed- 
back, out-of-field observers are expected to judge whether the teacher 
has appropriately considered the difficulties learners may encounter and 
taken appropriate steps to alleviate the problem through feedback. An 
out-of-field observer evaluating physics instruction quality is roughly anal- 
ogous to a weekend sports fan serving as the home plate umpire in a 
m^'or league game. The entire quality of the game depends on accuracy 
of the calls, but the caller cannot quickly and directly identify the distinc- 
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tions between a ball and a strike. One missing program in the history of 
research on teaching has been the consideration of subject matter (Shul- 
man, 1985). Its absence is even more noteworthy in assessment designs 
that propose to compare teachers across subject areas, using observers 
who have little or no knowledge of the subjects being taught. 

A fourth miscommunication is the potential for valuing form above 
content. The problematic nature of communications that emphasize form 
and style rather than content is a complaint dating back to Plato and 
Aristotle. Speaking skills and styles can be taught, but communicating so 
others can understand the content of the communication is quite a dif- 
ferent matter. Leinhardt's (1985) study of elementary mathematics instruc- 
tion documents the differences between knowledgeable elementary math 
teachers and those who are less knowledgeable. Less knowledgeable 
teachers tend to rely more on the textbook and give explanations that 
confuse rather than clarify. It is difficult to understand how the current 
assessment systems would differentiate between a text dependent (but 
technically correct) teacher who shows superior vocal ability and a teacher 
who has mastered the art of explaining a difficult concept but who cannot 
do so through "intense or dramatic expression in gestures, movements, 
vocal inflections, or facial changes" (see McCaleb, chapter 1). It would be 
a dangerous miscommunication if assessments send the message that 
excellence in teaching is more an issue of form than of subject matter 
content. 

Finally, another potential for miscommunication is that assessments 
imply teachers are expected to talk more than listen and only teachers 
can provide feedback or reteach. The observation instruments used in 
process-product research focused more on teacher behaviors and less on 
student behaviors, attributing the cause of desirable student outcomes to 
teacher actions. Critics have argued that all classroom proceedings are 
mediated by the individual student (Doyle, 1978). Research on students' 
cognition during instruction (Wittrock, 1986) suggests that there are many 
different interpretations of instruction. For example, students may be 
aware when they are not attending to instruction, but they may be unaware 
that they do not understand a concept or skill. Research on learning and 
memory (Weinstein & Mayer, 1986) suggests that students must play an 
active role in instruction and teachers must devise ways to monitor 
students' progress more closely than can be done through a worksheet 
exercise. Finding the source of students' errors, informing the students 
of errors, and providing students with training in metacognitive strategies 
may be important to helping students in task specific situations not typi- 
cally measured by standardized tests. 

These lines of research suggest that monitoring is a highly complex 
process that involves more time than a quick check for understariding 
allows. Helping students shed prior misconceptions in order to under- 
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stand the correct explanation may take considerable time for diagnosis 
and roteachlng. The process of diagnosis and prescriptive reteaching is 
closely aligned with subject matter knowledge. Teachers must know the 
potential for misconceptions and create learning environments that allow 
those misconceptions to be identified. Teachers are responsible for designing 
instruction that will enable students to replace the old, incorrect concept 
with the new, correct concept. Identification, diagnosis, and reteaching 
require considerable knowledge, pedagogical sophistication, and skill. 
Expert teachers are flexible enough to aVcer plans midstream when the 
occasion demands (Berliner, 1986). This flexibility may not be encouraged 
to develop through assessments that stress only one form of classroom 
communication. 

The implication is that teachers will need to establish a classroom 
ethos that does not penalize students for showing the teacher they made 
a mistake. Students must have learning experiences that will enable them 
to recognize and correct their errors, either individually or with help from 
others. Those who understand will have positive educational experiences, 
but those who do not understand also need to have positive experiences 
that enable learning to occur. 



he view of teaching implied by current assessments casts the teacher 



X in the role of a highly skilled actor or actress. Consider McCalebs 
12 categories again. Five — correctness, mechanics, fluency, enthusiasm 
and nonverbal communication, and emphasis — are directly concerned 
with vocal and visual performing skills and techniques. The categories 
that are more interactive — feedback, questioning, giving of direction, 
interactions with students, and interactions with parents — still focus on 
the teacher's verbal abilities rather than the teachers responsibility to 
develop students* communicative skills. As mentioned earlier, the picture 
emerges of a knowledgeable, fluent speaker who is also skilled in inter- 
personal relations. Indeed, several educational researchers have sug- 
gested that we train teachers in much the same way that we train actors 
(Gage, i978; Travers, 1981). Microteaching and peer teaching could be 
compared to acting class. But perhaps we are using the wrong metaphor. 

The vision of the teacher as actor limits our vision to familiar, albeit 
idealistic, scenarios of successful teaching in which teachers command 
center stage and hold the audiences rapt attention while delivering a 
virtuoso performance. The vocal qualities are evident; the flawless speech 
is appropriate for the role and captivates and moves the audience. The 
improvised sections are focused and the meaning is clearly shared among 
the players. The gestures and facial expressions convey a feeling of excite- 
ment, which cues audience members who occasionally join in the impro- 
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visation as well as those who only observe. Perhaps we are thinking of 
students as patrons who attend classrooms much as audiences attend the 
theatre. 

But what if we shift the theatrical metaphor and consider the students 
as actors and the teacher as director? What communication skills could 
be assessed using this metaphor? And are they congruent with the skills 
currently being assessed? 

An actor is primarily concerned with self; a director is concerned 
with the total production. That is consistent with the role of the teacher, 
who must be concerned with the classroom as a whole, including the 
relationships and the proceedings within the classroom as well as those 
relationships and proceedings between the class and the school and the 
class and the community. The actor i is limited freedom to interpret the 
script (and no freedom under some directors). The director, according to 
Sir Laurence Olivier, "know[s] the play so well that he grasps eveiy 
important moment of every scene. He knows — and he alone — when the 
action should rise and where it should fall. He knows where to place the 
accents" (Cole & Chinoy, 1983, p. 412). The director must also guide the 
actors as individuals. According to Franco Zeffirelli, "You can't force an 
actor. He doesn't play with his technique, he plays with his own human 
qualities. My job is to offer many different solutions to him, and then to 
choose the right one. It may be comic or tragic, but it must be the right 
one /or him. It must become part of his own blood and flesh" (Cole & 
Chinoy 1963, p. 438). 

Using the director as a metaphor, then, would give increased impor- 
tance to the relationships between what a teacher plans, knowledge and 
skill that shape those plans, students^ res^ionses as those plans EJ-e imple- 
mented, and ate acher's responses to the students. The classroom observer 
is forced to probe beneath the surface behaviors recorded on an obser- 
vation schedule for the intentions of a lesson, consider the teacher's 
perceptions of how that lesson was implemented, and record how each 
student worked through the lesson, modifying plans as needed. 

FLEXIBLE ASSESSMENT PROCEDURES 

It is unnecessary to completely abandon the communication skills cur- 
rently used. Sets or ranges of alternative behaviors need to be identified, 
however The changes should address the miscommunications identified 
earlier: 

1. Research has identified behaviors that teachers can follow to 
guarantee successful teaching. 

2. The universe of desirable communication skills are limited to 
those being assessed, emphasizing presentational behaviors. 

3. Subject matter is not a consideration when evaluating teaching. 
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4. Excellence in teaching is more an issue of form than of subject 
matter content. 

5. Desirable student outcomes are attributed to teacher actions with 
little recognition of student mediation. 

6. Monitoring is accomplished through a quick check for understand- 
ing. 

7. Teachers are expected to talk more than listen and only teachers 
provide feedback or reteach. 

The flexible assessment procedures should be consistent with a 
teacher s purposes and goals and reward teachers for making corrections 
to the lesson "in flight" if the occasion warranted. A system that allowed 
time to talk with teachers before the lesson might give an observer richer 
evidence on interpersonal skills and clue the observer to watch for certain 
events. Time to talk after the lesson, perhaps to review a vidi »otape of the 
lesson, would enable a teacher to explain the reasons for decisions that 
deviated from the original plan. Such deviation is consistent with recent 
research on expert teaching (Berliner, 1986) that suggests expert teachers 
function as able executives who can flex to the demands of the immediate 
classroom situation. 

Working v. 1th olhers and helping them to achieve individual goals as 
well as group goals are more difficult tasks than working alone. The product 
is more uncertain and the process is unstable and open to continuous 
negotiation between the concerned parties. There is some evidence from 
the fledgling research on learning to teach (Doyle, 1985; Grossman, 
Reynolds, Ringstaff, & Sykes, 1985; Clift & Morgan, 1986) that teacher edu- 
cation courscwork and early* classroom experiences shift one's focus from 
self as learner to self as one who directs the learning of others. An assessment 
system that takes advantage of this focus and provides diagnostic feedback 
as well as a yearly evaluation would seem to work with teachers rather than 
against them. And that is the final potenti£d miscommunication that may 
result from the current assessment sfystems. Teachers may receive the mes- 
sage that they are not allowed to make mistakes and to learn from them, 
administrators at all levels are enemies, or professional control is centered 
in the state capital rather than the classrooms. 

Shulman (1983) has argued that, "Educational policies must be designed 
as a shell within which the kernel of professional judgment and decision 
making can function comfortably. The policymaker can no longer thii'ik 
of any given mandate as a directive which bears continuing correspo^i- 
dence to teacher action at all times" (p. 501). Assessment policies that 
communicate respect for the classroom teacher's knowledge combined 
with implementation plans that include professional development for the 
directors of student learning will avoid most possibilities for damaging 
professional miscommunication outlined in this chapter. 
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CONCLUSION 



Implications for Improving Communication 

While the primary task of this monograpli has been to describe and 
evaluate the conceptualizations of communication found in assessrnent 
practices, implications for the development of effective comniunication 
can also be found. Several recurring conclusions throughout the mono- 
graph are summarized below. 

1. The assessments of teachers' communication have provided a 
valuable service in identifying significant dimensions of communication. 

The 12 categories described in chapter 1 offer assistance to persons 
concerned with content validity by defining in precise terms a substantial 
part of instructional communication's "content universe." Although these 
categories, even collectively do not constitute a sufficient conceptuali- 
zation of communication, they do isolate important dimensions. As is 
expected of a complex concept in a complex environment, each dimen- 
sion has the potential of being taken from context and misused. Still, each 
category appears to have merit in defining a needed component for the 
repertoire of an effective communicator in an instructional setting. There- 
fore, the 12 categories should be useful for preservice and/or inservice 
planners. Other useful resources include Brown's list of books that have 
been prepared for the improvement of teachers' communications (see 
p. 43) and the Speech Communication Association's (SCA) annotated 
bibliographies on sources for improving instructional communication. 
The SCA also has developed standards for test development (see Appen- 
dix). 

Most of the authors note that the communication behj.^viors from 
these 12 categories are often associated with a linear model of commu- 
nication; i.e., the emphasis is upon the teacher sending information to the 
learners. While this emphasis is insufficient for all communication events, 
it demonstrates some of the most essential behaviors needed by an effec- 
tive teacher For example, teachers must be able to present clear expla- 
nations. The basic components of effective explanations have been rather 
well defined (e.g., Cniickshank, 1986; Gage, Belgard, Dell, Hiller, Rosen- 
shine, & Unruh, 1968; McCaleb & Rosenthal, 1984). Researchers have 
begun to refine the design of training programs for developing teacher 
clarity (e.g.. Book & McCaleb, 1987; Glueckner, 1983; Moore, 1987). Simi- 
larly, the concept of monitoring has been refined to a point where explicit 
training can be presented (see chapter 1). 

2. Effectiveness as a communicator demands attention to contextual 
variables. Perhaps the best illustration of this comes from the research 
on the effective use of praise. Brophy (1981) illustrates the way that 
effective communicators make ac^ustments for learning ability, grade 
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level, and other student characteristics. Several authors in this monog? aph 
also showed that effective instriiciiOin in different content fields may 
require different communication ski 'i.s. 

3. While communication behaviorN associated with a linear model of 
communication (e.g., explaining and m<ichanics) should be developed, 
the transactional view of communication ntnst be incorporated into a 
comprehensive understanding of effective communication. A transac- 
tional perspective assumes that com;aunication involves something hap- 
pening in the classroom that shows a sharing of meaning among teacher 
and ie.?rners rather than just a transfer of information. Transactional 
communication promotes instructional events that go beyond what is 
specifically planned by the teacher. Leainers are stimulated to propose 
ideas and insights that were not expected by the teacher, atid the teacher 
gains understandings through the communication process. The transac- 
'! i</nal perspective poses problems for assessment, but qualitative meth- 
odology, including interviews with participants, allows glimpses of it. The 
particular implication for persons trying to develop effective communi- 
cation is to see beyond the restrictions of the more easily measured 
communication behaviors and to enable teachers to understand and to 
apply a transactional perspective. 

4. Authors in this monograph seem particularly excited by the poten- 
tial relationship between communication and the concept of pedagogical 
content knowledge. As described in chapter 1, pedagogical content knowl- 
edge involves a structure for specific content provided by a teacher in 
order to effectively present the content to a specific group of learners. 
This structure differs from the way an expert in the discipline organizes 
content knowledge. Each chapter contributed to this concept. In chapter 
2, the skill area of analyzing the situation promotes the restructuring of 
content as the teacher incorporates information about learners and cur- 
riculum. In order to make the connections with the learners and to restruc- 
ture content, the teacher uses role taking and adaptive communication 
as described in chapter 3. Part of the adaptive communication is the 
modeling of thought, discussed by Book and Duffy in chapter 4. Chapter 
5 notes that feedback should reflect fine-tuning associated with content 
expertise. 

5. Other points made in individual chapters merit the attention of 
those trying to improve the communication of teachers. For example, in 
charrer 2, Feezel emphasizes the willingness or motivation to communi- 
cate, a dimension relatively ignored in assessment and assistance. Teacher 
education programs might assist teachers in gaining an understanding of 
their attitudes toward communication and the effects of tLose attitudes ! 
on learners (McCroskey, 1977). For example, an extroverted hi' V school 
teacher might increase empathy with the student who is afraVi to talk, 
even to peers. Feezel also shows the relevance of the functional approach. 
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A SCA subcommittee report (Cooper, 1986) elaborates this approach, 
identifying competencies in the five functional areas. 

In chapter 3, Brown develops the role of language in teaching. As 
teachers increase awareness of specialized terminology used in their 
content fields and in pedagogical language, th(^y can construct more 
considerate definitions and explicit instruction. Closely related is the 
notion of conceptual consistency developed by Book and Duffy in chapter 
4. Learning can be enhanced when teachers distinguish si^jiificant points 
from illustrative material and then cue these differences for learners 
periodically Again, preservice and inservice efforts can contribute fay 
identifying the significant points, polishing strategies for emphasizing 
these points, and promoting teachers' awareness of how and when they 
emphasize the significant material. 

Finally, chapter 5 provides a means of synthesis with an instructive 
metaphor. The teacher is often, even if implicitly, conceptualized as a 
performer, an actor. Clift shifts the theatrical metaphor to the director. 
This metaphor advances the varied communication roles needed by the 
teacher: the teacher knows the content more broadly than from one role; 
the teacher makes important design decisions; and, perhaps most criti- 
cally, the teacher takes risks in creating a successful production. 
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APPENDIX 



SCA CRITERIA FOR EVALUATING 
INSTRUMENTS AND PROCEDURES FOR 
ASSESSING SPEAKING AND LISTENING 

The following criteria may be applied to published and unpublished 
instruments aiid procedures for assessing speakiiig and listening 
skills of children and adults. These guidelines are presented here together 
with information describing how »^'^ers of speaking and listening assess- 
ment instruments can use the piovedures in a manner consistent with 
accepted testiiig practices. Originally published in 1980, the criteria (1986) 
have been revised to confoxm to the Educational Testing Service's pub- 
lished guidelines on appropr late test use. The criteria ai e organized in a 
manner consistent with ETS standards. 

A. Purposes of Tes ting. As the purposes of educational testing vary widely, 
the lollowing criteria describe the Speech Communication Associa- 
tion's position on the purposes of assessing speaking and listening 
skills. It is critically important to the testing procedure that the purpose 
of the testing be well defined before a test is developed or adopted. 
Lack of a match between purpose and instrument may lead to invalid 
test results. 

1. Stimulus materials should require the indivi'dual being tested to 
demonstrate skill as a speaker or listener. 

2. Assessment instruments and procedures should clearly distinguish 
speaking and listening performance from reading and witing abil- 
ity; i.e., inferences of speaking and listening competence should not 
be made irom tests of reading and writing, and directions and 
responses for speaking and/or listening tests should not be mediated 
through reading and writing modes. 

3. Assessment should confirm the degree to which a skill is present 
or absent, and not diagnose reasons why individuals demonstrate 
or fail to demonstrate those skills. 

4. Assessment should emphasize the application of speaking and lis- 
tening skills to familiar situations, i.e., stimulus materials should 
refer to situations recognizable to the individual being tested and 
should facilitate demonstration of skills rather than demonstration 
of mastery of a specified content. 
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5. Any assessment of oral skills should reflect more than one com- 
munication setting (e.g., interpersonal, small group, public, and 
mass communication settings) rather than be a generalization about 
skills when only one setting is used. 

B. Qualification of Test Users. Necessary qualifications of test users vary 
with the test or assessment procedure being used. Many assessment 
procedures can be effectively administered by the classroom teacher. 
Other procedures require a varying degree of training on the part of 
the test administrator, and many testing procedures require training 
in speech communication. What is most important is that every test 
administrator in a given testing program receive enough training and 
practice with the assessment procedure to ensure adequate rater reli- 
ability. When a testing procedure is being considered for use, careful 
attention should be paid to the requirements regarding the adrriinis- 
tration of the test. 

C. Test Selection. In addition to the criteria described in the other sections 
of this document, the following criteria are suggested by SCA to aid 
in selecting an appropriate test. 

1. Assessment instruments should be free of sexual, cultural, racial, 
and ethnic content and/or stereotyping. 

2. Assessment should permit a range of acceptable responses, where 
such a range is appropriate. 

3. Assessment should demonstrate that outcomes are more than just 
chance evidence; i.e., assessment should be reliable. 

4. Assessment should provide results that are consistent with other 
evidence that might be available. 

5. Assessment should have content validity. 

6. Assessment should be suitable for the developmental level of the 
individual being tested. 

D. Test Administration. The following criteria speak to the guidelines 
suggested by SCA regarding test administration. Together with the 
information on the qualifications of test users, these criteria provide 
assistance on test use and administration. 

1. Assessment procedures should be standardized and detailed enough 
so that individual responses will not be affected by the administra- 
tors skills in administering the procedures. 

2. Assessment procedures should approximate the recognized stress 
level of oral communication; the procedures and setting should not 
increase or eliminate it. 

3. Assessment procedures should be practical in terms of cost and 
time. 

4. Assessment should involve simple equipment. 
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Scoring Tests. Each testing procedure should use a standardized ficore 
she et to record the ratings. IVlost assessment procedures includr scor- 
ing instructioi^s. If the test srores jire to he used for purposes other 
than feedback to the individual student, v.^ en summary sheets should 
be constructed that ensure testee anonymity. 

K Interpreting Test Scores. Interpretation of tesr ?'c ore^s may be ihe prov- 
ince of the individual teacher or other adminij;aator. If tr'ere are not 
national norms for the speaking/listening asses^jmejiC pn^cedure, cut- 
off scores for use in placement, development of educational objectives, 
remediation, etc. should be set and agreed upon by the appropriate 
teachers/administrators. Scores should also reflect the nature of the 
context for conditions used in the test. 

G. Communicating Test Results. Under normal circumstances, individual 
test results should be considered confidential information. Individual 
scores should be communicated to the students and/or parents in a 
confidential manner Use of test scores for the development of test 
norms for educational objectives or for trend analysis should be 
accomplished while maintaining individual test score confidentiality. 
Test results should only be reported in a way that explains the nature 
of the levels being reported. 

H. Handling of Data. Data should be handled in accordance with F and 
G above. Procedures for handling data should be developed to fit local 
needs. Assessment should occur immediately prior to the use of the 
ratings or scores so that data are current. Data may be retained in 
student records but should be considered as potentially obsolete after 
one year. 

I. Monitoring Compliance with Guidelin' .ich school, district, or insti- 
tution using a testing procedure in speaking and listening should 
appoint an individual whose duties include periodic checks to see 
raters are following the testing procedures accurately, that scores are 
being dealt with appropriately, and that complaints or disputes are 
handled expediently. 

Criteria developed (1980) by Philip M. Backlund, Kenneth L. Brown, Joanne 
Gurry, and Fred E. Jandt acting as a subgroup of the Speech Communi- 
cation Association's Committee on Assessment and Testing. Approved 
and endorsed by the Educational Policies Board and the Administrative 
Committee of the Speech Communication Association. Revised, Decem- 
ber 1986, under the direction of the SCAs Committee on Assessment and 
Testing's standards subcommittee, Philip M. Backlund, Chair; Members 
Rebecca Rubin and Don Boileau. 
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